Jun 25 16:54:46 devstack cinder-volume[82344]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 25 16:54:46 devstack cinder-volume[82344]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 16:54:46 devstack cinder-volume[82344]: we strongly recommend against using it for new projects. Jun 25 16:54:46 devstack cinder-volume[82344]: If you are already using Eventlet, we recommend migrating to a different Jun 25 16:54:46 devstack cinder-volume[82344]: framework. For more detail see Jun 25 16:54:46 devstack cinder-volume[82344]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 16:54:46 devstack cinder-volume[82344]: import eventlet # noqa Jun 25 16:54:49 devstack cinder-volume[82344]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82344) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 16:54:49 devstack cinder-volume[82344]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82344) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 16:54:49 devstack cinder-volume[82344]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82344) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 16:54:50 devstack cinder-volume[82344]: INFO dbcounter [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Registered counter for database cinder Jun 25 16:54:50 devstack cinder-volume[82344]: DEBUG oslo_db.sqlalchemy.engines [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82344) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 16:54:50 devstack cinder-volume[82344]: DEBUG dbcounter [-] [82344] Writer thread running {{(pid=82344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 25 16:54:50 devstack cinder-volume[82344]: INFO cinder.rpc [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 25 16:54:50 devstack cinder-volume[82344]: INFO cinder.rpc [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 25 16:54:50 devstack cinder-volume[82344]: DEBUG oslo_db.sqlalchemy.engines [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82344) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 16:54:51 devstack cinder-volume[82344]: INFO cinder.volume.manager [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Determined volume DB was empty at startup. Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG cinder.volume.manager [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82344) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 25 16:54:51 devstack cinder-volume[82344]: INFO cinder.volume.manager [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 25 16:54:51 devstack cinder-volume[82344]: WARNING stevedore.named [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 25 16:54:51 devstack cinder-volume[82344]: WARNING castellan.key_manager [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 16:54:51 devstack cinder-volume[82344]: WARNING cinder.keymgr.conf_key_mgr [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG cinder.volume.drivers.lvm [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82344) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_concurrency.processutils [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_concurrency.processutils [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] CMD "cinder-rtstool verify" returned: 0 in 0.539s {{(pid=82344) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_db.sqlalchemy.engines [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82344) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 16:54:51 devstack cinder-volume[82344]: INFO cinder.rpc [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 25 16:54:51 devstack cinder-volume[82344]: INFO cinder.rpc [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 25 16:54:51 devstack cinder-volume[82344]: WARNING stevedore.named [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 25 16:54:51 devstack cinder-volume[82344]: WARNING castellan.key_manager [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 16:54:51 devstack cinder-volume[82344]: INFO cinder.volume.manager [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_db.sqlalchemy.engines [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82344) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 16:54:51 devstack cinder-volume[82344]: INFO oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Starting 1 workers Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Started child 82510 {{(pid=82344) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Full set of CONF: {{(pid=82344) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] ******************************************************************************** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Configuration options gathered from: {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] ================================================================================ {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] allow_availability_zone_fallback = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] allow_compression_on_image_upload = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] allowed_direct_url_schemes = [] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] api_rate_limit = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] auth_strategy = keystone {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] az_cache_duration = 3600 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_availability_zone = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_host = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_name = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82510]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_stats_polling_interval = 60 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backup_api_class = cinder.backup.api.API {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backup_name_template = backup-%s {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backup_use_same_host = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backup_use_temp_snapshot = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] chap_password = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] chap_username = {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cinder_internal_tenant_project_id = ef848515402d42509987630cfdabfb3c {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cinder_internal_tenant_user_id = 2f980ffbadd6470db318451856c7b46d {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cloned_volume_same_az = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cluster = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] compression_format = gzip {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] compute_api_class = cinder.compute.nova.API {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] config_dir = [] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] config_source = [] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] control_exchange = openstack {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] debug = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] default_availability_zone = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] default_group_type = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] default_volume_type = lvmdriver-1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] disk_geometry = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] driver_client_cert = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] driver_client_cert_key = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] driver_data_namespace = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] driver_ssl_cert_path = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] driver_ssl_cert_verify = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] driver_use_ssl = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] enable_force_upload = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] enable_new_services = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] enable_unsupported_driver = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] enforce_multipath_for_image_xfer = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] filter_function = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance_api_insecure = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance_api_servers = ['http://192.168.122.14/image'] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance_api_ssl_compression = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance_ca_certificates_file = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance_catalog_info = image:glance:publicURL {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance_certfile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance_keyfile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance_num_retries = 3 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance_request_timeout = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] goodness_function = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] graceful_shutdown_timeout = 5 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] group_api_class = cinder.group.api.API {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] host = devstack {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] image_compress_on_upload = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] image_conversion_address_space_limit = 1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] image_conversion_cpu_limit = 60 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] image_conversion_disable = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] image_upload_use_cinder_backend = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] image_upload_use_internal_tenant = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] image_volume_cache_enabled = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] image_volume_cache_max_count = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] image_volume_cache_max_size_gb = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] init_host_max_objects_retrieval = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] instance_format = [instance: %(uuid)s] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] iscsi_target_flags = {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] iscsi_write_cache = on {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] iser_helper = tgtadm {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] iser_ip_address = 192.168.122.14 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] iser_port = 3260 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] log_color = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] log_config_append = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] log_dir = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] log_file = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] log_options = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] log_rotate_interval = 1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] log_rotate_interval_type = days {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] log_rotation_type = none {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] max_age = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] max_logfile_count = 30 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] max_logfile_size_mb = 200 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] max_over_subscription_ratio = 20.0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] message_reap_interval = 86400 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] message_ttl = 2592000 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] migration_create_volume_timeout_secs = 300 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] monkey_patch = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] monkey_patch_modules = [] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] my_ip = 192.168.122.14 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] no_snapshot_gb_quota = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] num_iser_scan_tries = 3 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] num_shell_tries = 3 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] num_volume_device_scan_tries = 3 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] nvmeof_conn_info_version = 1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] nvmet_ns_id = 10 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] nvmet_port_id = 1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] osapi_max_limit = 1000 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] osapi_volume_ext_list = [] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] osapi_volume_listen_port = 8776 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] osapi_volume_use_ssl = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] osapi_volume_workers = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] per_volume_size_limit = -1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] periodic_fuzzy_delay = 60 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] periodic_interval = 60 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] public_endpoint = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] publish_errors = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] quota_backup_gigabytes = 1000 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] quota_backups = 10 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] quota_gigabytes = 1000 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] quota_groups = 10 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] quota_snapshots = 10 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] quota_volumes = 10 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] rate_limit_burst = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] rate_limit_except_level = CRITICAL {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] rate_limit_interval = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] reinit_driver_count = 3 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] replication_device = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] report_discard_supported = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] report_interval = 120 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] reservation_clean_interval = 86400 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] reservation_expire = 86400 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] reserved_image_namespaces = [] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] reserved_percentage = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] rpc_response_timeout = 120 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] run_external_periodic_tasks = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] scst_target_driver = iscsi {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] scst_target_iqn_name = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] service_down_time = 720 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] shell_completion = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] snapshot_name_template = snapshot-%s {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] snapshot_same_host = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] split_loggers = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] state_path = /opt/stack/data/cinder {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] storage_availability_zone = nova {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] storage_protocol = iSCSI {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] syslog_log_facility = LOG_USER {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] target_helper = lioadm {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] target_ip_address = 192.168.122.14 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] target_port = 3260 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] target_protocol = iscsi {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] target_secondary_ip_addresses = [] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] trace_flags = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] transport_url = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] until_refresh = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] use_chap_auth = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] use_default_quota_class = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] use_journal = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] use_json = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] use_multipath_for_image_xfer = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] use_stderr = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] use_syslog = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] verify_glance_signatures = enabled {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] volume_api_class = cinder.volume.api.API {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] volume_backend_name = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] volume_clear = zero {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] volume_clear_ionice = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] volume_clear_size = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] volume_copy_bps_limit = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] volume_dd_blocksize = 1M {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] volume_name_template = volume-%s {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] volume_service_inithost_offload = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] volume_usage_audit_period = month {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] zoning_mode = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_concurrency.disable_process_locking = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82510]: INFO cinder.volume.manager [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.auth_section = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.auth_type = password {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.auth_version = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.cache = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.certfile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.include_service_catalog = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.insecure = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.interface = public {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.keyfile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.memcache_password = {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.memcache_username = {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.region_name = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.service_type = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.14/identity {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.backend = dogpile.cache.null {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.backend_argument = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.backend_expiration_time = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.config_prefix = cache.oslo {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.debug_cache_backend = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.enable_retry_client = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.enable_socket_keepalive = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.enabled = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.expiration_time = 600 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.hashclient_retry_attempts = 2 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.memcache_dead_retry = 300 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.memcache_pool_maxsize = 10 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.memcache_sasl_enabled = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.password = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.proxies = [] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.redis_db = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.redis_server = localhost:6379 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.retry_attempts = 2 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.retry_delay = 0.0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.socket_keepalive_count = 1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.socket_keepalive_idle = 1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.socket_keepalive_interval = 1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.socket_timeout = 1.0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.tls_allowed_ciphers = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.tls_cafile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.tls_certfile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:51 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.tls_enabled = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.tls_keyfile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cache.username = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] coordination.backend_url = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.asyncio_connection = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.asyncio_slave_connection = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.backend = sqlalchemy {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.connection = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.connection_debug = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.connection_parameters = {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.connection_recycle_time = 3600 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.connection_trace = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.db_inc_retry_interval = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.db_max_retries = 20 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.db_max_retry_interval = 10 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.db_retry_interval = 1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.max_overflow = 50 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.max_pool_size = 5 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.max_retries = 10 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.mysql_wsrep_sync_wait = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.pool_timeout = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.retry_interval = 10 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.slave_connection = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.sqlite_synchronous = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:54:52 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.synchronous_reader = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] database.use_db_reconnect = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] profiler.connection_string = messaging:// {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] profiler.enabled = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] profiler.es_doc_type = notification {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] profiler.es_scroll_size = 10000 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] profiler.es_scroll_time = 2m {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] profiler.filter_error_trace = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] profiler.hmac_keys = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] profiler.sentinel_service_name = mymaster {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] profiler.socket_timeout = 0.1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] profiler.trace_requests = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] profiler.trace_sqlalchemy = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] profiler_jaeger.process_tags = {} {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] profiler_jaeger.service_name_prefix = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] profiler_otlp.service_name_prefix = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_policy.enforce_new_defaults = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: WARNING oslo_config.cfg [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_policy.enforce_scope = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_policy.policy_default_rule = default {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_policy.policy_file = policy.yaml {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack sudo[82515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 25 16:54:52 devstack sudo[82515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] privsep_osbrick.group = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] privsep_osbrick.helper_command = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] privsep_osbrick.user = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cinder_sys_admin.group = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cinder_sys_admin.helper_command = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] cinder_sys_admin.user = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] service_user.auth_section = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] service_user.auth_type = password {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] service_user.cafile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] service_user.certfile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] service_user.collect_timing = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] service_user.insecure = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] service_user.keyfile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] service_user.send_service_user_token = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] service_user.split_loggers = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] service_user.timeout = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance.auth_section = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance.auth_type = password {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance.certfile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance.collect_timing = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance.insecure = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance.keyfile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance.region_name = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance.split_loggers = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] glance.timeout = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.backend_availability_zone = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.chap_password = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.chap_username = {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.disk_geometry = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.driver_client_cert = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.driver_client_cert_key = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.driver_data_namespace = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.driver_use_ssl = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.extra_capabilities = {} {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.filter_function = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.goodness_function = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.iscsi_target_flags = {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.iscsi_write_cache = on {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.iser_helper = tgtadm {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.iser_ip_address = 192.168.122.14 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.iser_port = 3260 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.lvm_share_target = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.lvm_type = auto {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.num_shell_tries = 3 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.replication_device = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.report_discard_supported = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.reserved_percentage = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.target_helper = tgtadm {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.target_ip_address = 192.168.122.14 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.target_port = 3260 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.target_protocol = iscsi {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.trace_flags = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.unique_fqdn_network = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.use_chap_auth = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.volume_backend_name = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.volume_clear = zero {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.volume_clear_ionice = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.volume_clear_size = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_reports.file_event_handler = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_reports.log_dir = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.backend_host = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.chap_password = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.chap_username = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.disk_geometry = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.driver_client_cert = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.extra_capabilities = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.filter_function = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.goodness_function = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.iser_helper = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.iser_ip_address = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.iser_port = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.lvm_share_target = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.lvm_type = auto {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.num_shell_tries = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.replication_device = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.report_discard_supported = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.reserved_percentage = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.scst_target_driver = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.storage_protocol = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.target_helper = lioadm {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.target_ip_address = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.target_port = 3260 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.trace_flags = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.use_chap_auth = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.volume_clear = zero {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.volume_clear_size = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] lvmdriver-1.volumes_dir = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.ssl = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_notifications.driver = [] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_notifications.retry = -1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] key_manager.fixed_key = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican.barbican_api_version = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican.barbican_endpoint = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican.barbican_endpoint_type = public {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican.barbican_region_name = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican.cafile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican.certfile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican.collect_timing = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican.insecure = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican.keyfile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican.number_of_retries = 60 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican.retry_delay = 1 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican.send_service_user_token = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican.split_loggers = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican.timeout = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican.verify_ssl = True {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican.verify_ssl_path = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican_service_user.auth_section = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican_service_user.auth_type = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican_service_user.cafile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican_service_user.certfile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican_service_user.collect_timing = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican_service_user.insecure = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican_service_user.keyfile = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican_service_user.split_loggers = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] barbican_service_user.timeout = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] vault.approle_role_id = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] vault.approle_secret_id = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] vault.kv_mountpoint = secret {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] vault.kv_path = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] vault.kv_version = 2 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] vault.namespace = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] vault.root_token_id = **** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] vault.ssl_ca_crt_file = None {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] vault.timeout = 60.0 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] vault.use_ssl = False {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 16:54:52 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] ******************************************************************************** {{(pid=82344) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 25 16:54:52 devstack sudo[82515]: pam_unix(sudo:session): session closed for user root Jun 25 16:54:52 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.817s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:54:52 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:54:52 devstack sudo[82519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 16:54:52 devstack sudo[82519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:54:53 devstack sudo[82519]: pam_unix(sudo:session): session closed for user root Jun 25 16:54:53 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.715s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:54:53 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 16:54:53 devstack cinder-volume[82510]: INFO cinder.brick.local_dev.lvm [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 25 16:54:53 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:54:53 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:54:53 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:54:53 devstack sudo[82796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 16:54:53 devstack sudo[82796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:54:54 devstack sudo[82796]: pam_unix(sudo:session): session closed for user root Jun 25 16:54:54 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.741s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:54:54 devstack cinder-volume[82510]: DEBUG cinder.brick.local_dev.lvm [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82510) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 25 16:54:54 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:54:54 devstack sudo[83010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 16:54:54 devstack sudo[83010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:54:55 devstack sudo[83010]: pam_unix(sudo:session): session closed for user root Jun 25 16:54:55 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.482s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:54:55 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:54:55 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:54:55 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:54:55 devstack sudo[83287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 16:54:55 devstack sudo[83287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:54:56 devstack sudo[83287]: pam_unix(sudo:session): session closed for user root Jun 25 16:54:56 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.765s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:54:56 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:54:56 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:54:56 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:54:56 devstack sudo[83302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 25 16:54:56 devstack sudo[83302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:54:57 devstack sudo[83302]: pam_unix(sudo:session): session closed for user root Jun 25 16:54:57 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.918s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:54:57 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:54:57 devstack sudo[83306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 16:54:57 devstack sudo[83306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:54:58 devstack sudo[83306]: pam_unix(sudo:session): session closed for user root Jun 25 16:54:58 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.127s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:54:58 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:54:58 devstack sudo[83318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 16:54:58 devstack sudo[83318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:54:59 devstack sudo[83318]: pam_unix(sudo:session): session closed for user root Jun 25 16:54:59 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.897s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:54:59 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:54:59 devstack sudo[83327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 16:54:59 devstack sudo[83327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:55:00 devstack sudo[83327]: pam_unix(sudo:session): session closed for user root Jun 25 16:55:00 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.769s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:55:00 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:55:00 devstack sudo[83332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 16:55:00 devstack sudo[83332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:55:01 devstack sudo[83332]: pam_unix(sudo:session): session closed for user root Jun 25 16:55:01 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.707s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:55:01 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:55:01 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:55:01 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:55:01 devstack sudo[83336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 16:55:01 devstack sudo[83336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:55:01 devstack sudo[83336]: pam_unix(sudo:session): session closed for user root Jun 25 16:55:01 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.696s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:55:01 devstack cinder-volume[82510]: INFO cinder.volume.drivers.lvm [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 25 16:55:01 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:55:01 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:55:01 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:55:01 devstack sudo[83349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 16:55:01 devstack sudo[83349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:55:01 devstack cinder-volume[82344]: DEBUG dbcounter [-] [82344] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82344) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 16:55:02 devstack sudo[83349]: pam_unix(sudo:session): session closed for user root Jun 25 16:55:02 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.882s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:55:02 devstack cinder-volume[82510]: DEBUG cinder.volume.drivers.lvm [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Updating volume stats {{(pid=82510) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 16:55:02 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:55:02 devstack sudo[83466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 16:55:02 devstack sudo[83466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:55:03 devstack sudo[83466]: pam_unix(sudo:session): session closed for user root Jun 25 16:55:03 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.746s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:55:03 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:55:03 devstack sudo[83606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 16:55:03 devstack sudo[83606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:55:04 devstack sudo[83606]: pam_unix(sudo:session): session closed for user root Jun 25 16:55:04 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:55:04 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:55:04 devstack sudo[83609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 16:55:04 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:55:04 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root Jun 25 16:55:04 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.756s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:55:04 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:55:04 devstack sudo[83613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 16:55:04 devstack sudo[83613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:55:05 devstack sudo[83613]: pam_unix(sudo:session): session closed for user root Jun 25 16:55:05 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:55:05 devstack cinder-volume[82510]: INFO cinder.volume.driver [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Driver hasn't implemented _init_vendor_properties() Jun 25 16:55:05 devstack cinder-volume[82510]: DEBUG cinder.volume.driver [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82510) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 25 16:55:05 devstack cinder-volume[82510]: DEBUG oslo_db.sqlalchemy.engines [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82510) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 16:55:05 devstack cinder-volume[82510]: DEBUG dbcounter [-] [82510] Writer thread running {{(pid=82510) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 25 16:55:05 devstack cinder-volume[82510]: DEBUG cinder.db.api [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Building query based on filter {{(pid=82510) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 25 16:55:05 devstack cinder-volume[82510]: DEBUG cinder.image.image_utils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82510) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 25 16:55:05 devstack cinder-volume[82510]: INFO cinder.keymgr.migration [None req-a1057e73-d9c8-4a95-a367-d3f4d376c2d4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 25 16:55:05 devstack cinder-volume[82510]: DEBUG cinder.volume.drivers.lvm [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Updating volume stats {{(pid=82510) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 16:55:05 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:55:05 devstack sudo[83620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 16:55:05 devstack sudo[83620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:55:06 devstack sudo[83620]: pam_unix(sudo:session): session closed for user root Jun 25 16:55:06 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.823s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:55:06 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:55:06 devstack sudo[83623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 16:55:06 devstack sudo[83623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:55:07 devstack sudo[83623]: pam_unix(sudo:session): session closed for user root Jun 25 16:55:07 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.803s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:55:07 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:55:07 devstack sudo[83626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 16:55:07 devstack sudo[83626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:55:08 devstack sudo[83626]: pam_unix(sudo:session): session closed for user root Jun 25 16:55:08 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.732s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:55:08 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:55:08 devstack sudo[83630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 16:55:08 devstack sudo[83630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:55:08 devstack sudo[83630]: pam_unix(sudo:session): session closed for user root Jun 25 16:55:08 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.691s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:55:08 devstack cinder-volume[82510]: DEBUG cinder.manager [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Notifying Schedulers of capabilities ... {{(pid=82510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 16:55:08 devstack cinder-volume[82510]: INFO cinder.volume.manager [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Driver initialization completed successfully. Jun 25 16:55:08 devstack cinder-volume[82510]: INFO cinder.manager [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Initiating service 2 cleanup Jun 25 16:55:08 devstack cinder-volume[82510]: INFO cinder.manager [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Service 2 cleanup completed. Jun 25 16:55:08 devstack cinder-volume[82510]: DEBUG cinder.service [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Creating RPC server for service cinder-volume {{(pid=82510) start /opt/stack/cinder/cinder/service.py:231}} Jun 25 16:55:08 devstack cinder-volume[82510]: DEBUG cinder.service [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82510) start /opt/stack/cinder/cinder/service.py:237}} Jun 25 16:55:08 devstack cinder-volume[82510]: INFO cinder.volume.manager [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 25 16:55:08 devstack cinder-volume[82510]: DEBUG cinder.volume.drivers.lvm [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Updating volume stats {{(pid=82510) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 16:55:08 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:55:08 devstack sudo[83633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 16:55:08 devstack sudo[83633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:55:09 devstack sudo[83633]: pam_unix(sudo:session): session closed for user root Jun 25 16:55:09 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.748s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:55:09 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:55:09 devstack sudo[83640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 16:55:09 devstack sudo[83640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:55:10 devstack sudo[83640]: pam_unix(sudo:session): session closed for user root Jun 25 16:55:10 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.773s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:55:10 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:55:10 devstack sudo[83754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 16:55:10 devstack sudo[83754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:55:11 devstack sudo[83754]: pam_unix(sudo:session): session closed for user root Jun 25 16:55:11 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.964s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:55:11 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:55:11 devstack sudo[84155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 16:55:11 devstack sudo[84155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:55:12 devstack sudo[84155]: pam_unix(sudo:session): session closed for user root Jun 25 16:55:12 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.863s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:55:12 devstack cinder-volume[82510]: INFO cinder.volume.manager [None req-c982e3b6-e281-4f83-8b9b-54016e801b4a None None] Driver post RPC initialization completed successfully. Jun 25 16:55:15 devstack cinder-volume[82510]: DEBUG dbcounter [-] [82510] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82510) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 16:55:21 devstack cinder-volume[82510]: DEBUG oslo_service.periodic_task [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running periodic task VolumeManager._thread_info {{(pid=82510) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 16:55:21 devstack cinder-volume[82510]: DEBUG cinder.volume.manager [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] thread count: 6 {{(pid=82510) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 16:55:21 devstack cinder-volume[82510]: DEBUG cinder.volume.manager [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] thread info: [<_MainThread(MainThread, started 136784123547776)>, , , , , ] {{(pid=82510) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 16:55:22 devstack cinder-volume[82510]: DEBUG dbcounter [-] [82510] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=82510) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 16:56:21 devstack cinder-volume[82510]: DEBUG oslo_service.periodic_task [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82510) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 16:56:21 devstack cinder-volume[82510]: DEBUG cinder.volume.drivers.lvm [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Updating volume stats {{(pid=82510) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 16:56:21 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:56:21 devstack sudo[85908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 16:56:21 devstack sudo[85908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:56:22 devstack sudo[85908]: pam_unix(sudo:session): session closed for user root Jun 25 16:56:22 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.714s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:56:22 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:56:22 devstack sudo[85912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 16:56:22 devstack sudo[85912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:56:22 devstack sudo[85912]: pam_unix(sudo:session): session closed for user root Jun 25 16:56:22 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:56:22 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:56:22 devstack sudo[85915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 16:56:22 devstack sudo[85915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:56:23 devstack sudo[85915]: pam_unix(sudo:session): session closed for user root Jun 25 16:56:23 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.674s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:56:23 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:56:23 devstack sudo[85918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 16:56:23 devstack sudo[85918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:56:24 devstack sudo[85918]: pam_unix(sudo:session): session closed for user root Jun 25 16:56:24 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:56:24 devstack cinder-volume[82510]: DEBUG cinder.manager [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Notifying Schedulers of capabilities ... {{(pid=82510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 16:56:24 devstack cinder-volume[82510]: DEBUG oslo_service.periodic_task [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running periodic task VolumeManager._thread_info {{(pid=82510) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 16:56:24 devstack cinder-volume[82510]: DEBUG cinder.volume.manager [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] thread count: 6 {{(pid=82510) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 16:56:24 devstack cinder-volume[82510]: DEBUG cinder.volume.manager [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] thread info: [<_MainThread(MainThread, started 136784123547776)>, , , , , ] {{(pid=82510) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 16:57:21 devstack cinder-volume[82510]: DEBUG oslo_service.periodic_task [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82510) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 16:57:21 devstack cinder-volume[82510]: DEBUG cinder.volume.drivers.lvm [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Updating volume stats {{(pid=82510) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 16:57:21 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:57:21 devstack sudo[89175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 16:57:21 devstack sudo[89175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:57:22 devstack sudo[89175]: pam_unix(sudo:session): session closed for user root Jun 25 16:57:22 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.697s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:57:22 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:57:22 devstack sudo[89180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 16:57:22 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:57:22 devstack cinder-volume[82510]: DEBUG dbcounter [-] [82510] Writing DB stats cinder:SELECT=1 {{(pid=82510) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 16:57:22 devstack cinder-volume[82510]: DEBUG dbcounter [-] [82510] Writing DB stats cinder:UPDATE=1 {{(pid=82510) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 16:57:22 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root Jun 25 16:57:22 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.700s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:57:22 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:57:22 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 16:57:22 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:57:23 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Jun 25 16:57:23 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.665s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:57:23 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:57:23 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 16:57:23 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:57:24 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Jun 25 16:57:24 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:57:24 devstack cinder-volume[82510]: DEBUG cinder.manager [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Notifying Schedulers of capabilities ... {{(pid=82510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 16:57:24 devstack cinder-volume[82510]: DEBUG oslo_service.periodic_task [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running periodic task VolumeManager._thread_info {{(pid=82510) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 16:57:24 devstack cinder-volume[82510]: DEBUG cinder.volume.manager [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] thread count: 6 {{(pid=82510) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 16:57:24 devstack cinder-volume[82510]: DEBUG cinder.volume.manager [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] thread info: [<_MainThread(MainThread, started 136784123547776)>, , , , , ] {{(pid=82510) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 16:58:21 devstack cinder-volume[82510]: DEBUG oslo_service.periodic_task [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82510) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 16:58:21 devstack cinder-volume[82510]: DEBUG cinder.volume.drivers.lvm [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Updating volume stats {{(pid=82510) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 16:58:21 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:58:21 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 16:58:21 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:58:22 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Jun 25 16:58:22 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.684s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:58:22 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:58:22 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 16:58:22 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:58:22 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Jun 25 16:58:22 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:58:22 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:58:22 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 16:58:22 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:58:23 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Jun 25 16:58:23 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.675s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:58:23 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:58:23 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 16:58:23 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:58:24 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Jun 25 16:58:24 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.714s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:58:24 devstack cinder-volume[82510]: DEBUG cinder.manager [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Notifying Schedulers of capabilities ... {{(pid=82510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 16:58:24 devstack cinder-volume[82510]: DEBUG oslo_service.periodic_task [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running periodic task VolumeManager._thread_info {{(pid=82510) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 16:58:24 devstack cinder-volume[82510]: DEBUG cinder.volume.manager [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] thread count: 6 {{(pid=82510) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 16:58:24 devstack cinder-volume[82510]: DEBUG cinder.volume.manager [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] thread info: [<_MainThread(MainThread, started 136784123547776)>, , , , , ] {{(pid=82510) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 16:59:21 devstack cinder-volume[82510]: DEBUG oslo_service.periodic_task [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82510) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 16:59:21 devstack cinder-volume[82510]: DEBUG cinder.volume.drivers.lvm [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Updating volume stats {{(pid=82510) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 25 16:59:21 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:59:21 devstack sudo[91808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 25 16:59:21 devstack sudo[91808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:59:22 devstack sudo[91808]: pam_unix(sudo:session): session closed for user root Jun 25 16:59:22 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:59:22 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:59:22 devstack sudo[91834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 16:59:22 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:59:22 devstack cinder-volume[82510]: DEBUG dbcounter [-] [82510] Writing DB stats cinder:SELECT=1 {{(pid=82510) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 16:59:22 devstack cinder-volume[82510]: DEBUG dbcounter [-] [82510] Writing DB stats cinder:UPDATE=1 {{(pid=82510) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 16:59:22 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root Jun 25 16:59:22 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:59:22 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:59:22 devstack sudo[91852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 25 16:59:22 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:59:23 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root Jun 25 16:59:23 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.685s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:59:23 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 16:59:23 devstack sudo[91880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 25 16:59:23 devstack sudo[91880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 16:59:23 devstack sudo[91880]: pam_unix(sudo:session): session closed for user root Jun 25 16:59:23 devstack cinder-volume[82510]: DEBUG oslo_concurrency.processutils [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=82510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 16:59:23 devstack cinder-volume[82510]: DEBUG cinder.manager [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Notifying Schedulers of capabilities ... {{(pid=82510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 16:59:24 devstack cinder-volume[82510]: DEBUG oslo_service.periodic_task [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] Running periodic task VolumeManager._thread_info {{(pid=82510) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 16:59:24 devstack cinder-volume[82510]: DEBUG cinder.volume.manager [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] thread count: 6 {{(pid=82510) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 16:59:24 devstack cinder-volume[82510]: DEBUG cinder.volume.manager [None req-16ca8695-a304-476d-b31a-4574459b4027 None None] thread info: [<_MainThread(MainThread, started 136784123547776)>, , , , , ] {{(pid=82510) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:00:17 devstack cinder-volume[82344]: INFO oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Caught SIGTERM, stopping children Jun 25 17:00:17 devstack cinder-volume[82344]: DEBUG oslo_concurrency.lockutils [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Acquiring lock "singleton_lock" {{(pid=82344) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 17:00:17 devstack cinder-volume[82344]: DEBUG oslo_concurrency.lockutils [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Acquired lock "singleton_lock" {{(pid=82344) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 17:00:17 devstack cinder-volume[82344]: DEBUG oslo_concurrency.lockutils [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Releasing lock "singleton_lock" {{(pid=82344) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 17:00:17 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Stop services. {{(pid=82344) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 25 17:00:17 devstack cinder-volume[82344]: DEBUG oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Killing children. {{(pid=82344) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 25 17:00:17 devstack cinder-volume[82344]: INFO oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Waiting on 1 children to exit Jun 25 17:00:18 devstack cinder-volume[82510]: DEBUG oslo_concurrency.lockutils [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Acquiring lock "singleton_lock" {{(pid=82510) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 17:00:18 devstack cinder-volume[82510]: DEBUG oslo_concurrency.lockutils [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Acquired lock "singleton_lock" {{(pid=82510) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 17:00:18 devstack cinder-volume[82510]: DEBUG oslo_concurrency.lockutils [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Releasing lock "singleton_lock" {{(pid=82510) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 17:00:18 devstack cinder-volume[82510]: WARNING amqp [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 25 17:00:18 devstack cinder-volume[82510]: WARNING amqp [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 25 17:00:18 devstack cinder-volume[82344]: INFO oslo_service.backend._eventlet.service [None req-3bb0c152-9362-41d3-bb30-1bacb3622086 None None] Child 82510 exited with status 0 Jun 25 17:00:19 devstack cinder-volume[93071]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 25 17:00:19 devstack cinder-volume[93071]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 17:00:19 devstack cinder-volume[93071]: we strongly recommend against using it for new projects. Jun 25 17:00:19 devstack cinder-volume[93071]: If you are already using Eventlet, we recommend migrating to a different Jun 25 17:00:19 devstack cinder-volume[93071]: framework. For more detail see Jun 25 17:00:19 devstack cinder-volume[93071]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 17:00:19 devstack cinder-volume[93071]: import eventlet # noqa Jun 25 17:00:21 devstack cinder-volume[93071]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93071) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 17:00:21 devstack cinder-volume[93071]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93071) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 17:00:21 devstack cinder-volume[93071]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93071) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 17:00:21 devstack cinder-volume[93071]: INFO dbcounter [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Registered counter for database cinder Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_db.sqlalchemy.engines [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93071) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG dbcounter [-] [93071] Writer thread running {{(pid=93071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 25 17:00:22 devstack cinder-volume[93071]: INFO cinder.rpc [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 25 17:00:22 devstack cinder-volume[93071]: INFO cinder.rpc [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_db.sqlalchemy.engines [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93071) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 17:00:22 devstack cinder-volume[93071]: INFO cinder.volume.manager [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Determined volume DB was empty at startup. Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG cinder.volume.manager [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93071) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 25 17:00:22 devstack cinder-volume[93071]: INFO cinder.volume.manager [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 25 17:00:22 devstack cinder-volume[93071]: WARNING stevedore.named [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 25 17:00:22 devstack cinder-volume[93071]: WARNING castellan.key_manager [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 17:00:22 devstack cinder-volume[93071]: WARNING cinder.keymgr.conf_key_mgr [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 17:00:22 devstack cinder-volume[93071]: INFO cinder.volume.manager [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_db.sqlalchemy.engines [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93071) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 17:00:22 devstack cinder-volume[93071]: INFO oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Starting 1 workers Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Started child 93287 {{(pid=93071) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Full set of CONF: {{(pid=93071) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 25 17:00:22 devstack cinder-volume[93287]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] ******************************************************************************** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Configuration options gathered from: {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] ================================================================================ {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] allow_availability_zone_fallback = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] allow_compression_on_image_upload = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] allowed_direct_url_schemes = [] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] api_rate_limit = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] auth_strategy = keystone {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_availability_zone = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_host = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_name = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_stats_polling_interval = 60 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backup_api_class = cinder.backup.api.API {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backup_name_template = backup-%s {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backup_use_same_host = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backup_use_temp_snapshot = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] chap_password = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] chap_username = {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cinder_internal_tenant_project_id = ef848515402d42509987630cfdabfb3c {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cinder_internal_tenant_user_id = 2f980ffbadd6470db318451856c7b46d {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cluster = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] compression_format = gzip {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] compute_api_class = cinder.compute.nova.API {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] config_dir = [] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] config_source = [] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] control_exchange = openstack {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] debug = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] default_availability_zone = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] default_group_type = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] default_volume_type = QuobyteHD {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] disk_geometry = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] driver_client_cert = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] driver_client_cert_key = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] driver_data_namespace = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] driver_ssl_cert_path = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] driver_ssl_cert_verify = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] driver_use_ssl = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] enable_new_services = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] enable_unsupported_driver = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] enabled_backends = ['QuobyteHD'] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] enforce_multipath_for_image_xfer = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] filter_function = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance_api_insecure = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance_api_servers = ['http://192.168.122.14/image'] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance_api_ssl_compression = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance_ca_certificates_file = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance_catalog_info = image:glance:publicURL {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance_certfile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance_keyfile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance_num_retries = 3 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance_request_timeout = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] goodness_function = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] graceful_shutdown_timeout = 5 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] group_api_class = cinder.group.api.API {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] host = devstack {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] image_compress_on_upload = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] image_conversion_address_space_limit = 1 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] image_conversion_cpu_limit = 60 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] image_conversion_disable = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] image_upload_use_cinder_backend = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] image_upload_use_internal_tenant = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] image_volume_cache_enabled = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] image_volume_cache_max_count = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] image_volume_cache_max_size_gb = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] init_host_max_objects_retrieval = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] instance_format = [instance: %(uuid)s] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] iscsi_target_flags = {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] iscsi_write_cache = on {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] iser_helper = tgtadm {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] iser_ip_address = 192.168.122.14 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] iser_port = 3260 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] log_color = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] log_config_append = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] log_dir = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] log_file = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] log_options = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] log_rotate_interval = 1 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] log_rotate_interval_type = days {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] log_rotation_type = none {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] max_age = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] max_logfile_count = 30 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] max_logfile_size_mb = 200 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93287]: INFO cinder.volume.manager [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 25 17:00:22 devstack cinder-volume[93287]: DEBUG cinder.volume.drivers.remotefs [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93287) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] max_over_subscription_ratio = 20.0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] message_reap_interval = 86400 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] message_ttl = 2592000 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] migration_create_volume_timeout_secs = 300 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] monkey_patch = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] monkey_patch_modules = [] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] my_ip = 192.168.122.14 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] no_snapshot_gb_quota = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] num_iser_scan_tries = 3 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] num_shell_tries = 3 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] num_volume_device_scan_tries = 3 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] nvmeof_conn_info_version = 1 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] nvmet_ns_id = 10 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] nvmet_port_id = 1 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] osapi_max_limit = 1000 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] osapi_volume_ext_list = [] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] osapi_volume_listen = 0.0.0.0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] osapi_volume_listen_port = 8776 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] osapi_volume_use_ssl = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] osapi_volume_workers = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] per_volume_size_limit = -1 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] periodic_fuzzy_delay = 60 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] periodic_interval = 60 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] project_id_regex = [0-9a-f\-]+ {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] public_endpoint = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] publish_errors = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] quota_backup_gigabytes = 1000 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] quota_backups = 10 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] quota_gigabytes = 1000 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] quota_groups = 10 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] quota_snapshots = 10 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] quota_volumes = 10 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] rate_limit_burst = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] rate_limit_except_level = CRITICAL {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] rate_limit_interval = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] reinit_driver_count = 3 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] replication_device = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] report_discard_supported = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] report_interval = 120 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] reservation_clean_interval = 86400 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] reservation_expire = 86400 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] reserved_image_namespaces = [] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] reserved_percentage = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] rpc_response_timeout = 120 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] run_external_periodic_tasks = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] scst_target_driver = iscsi {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] scst_target_iqn_name = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] service_down_time = 720 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] shell_completion = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] snapshot_name_template = snapshot-%s {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] split_loggers = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] state_path = /opt/stack/data/cinder {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] storage_availability_zone = nova {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] storage_protocol = iSCSI {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] syslog_log_facility = LOG_USER {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] target_helper = lioadm {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] target_ip_address = 192.168.122.14 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] target_port = 3260 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] target_protocol = iscsi {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] target_secondary_ip_addresses = [] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] trace_flags = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] transfer_api_class = cinder.transfer.api.API {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] transport_url = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] until_refresh = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] use_chap_auth = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] use_default_quota_class = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] use_journal = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] use_json = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] use_multipath_for_image_xfer = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] use_stderr = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] use_syslog = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] verify_glance_signatures = enabled {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] volume_api_class = cinder.volume.api.API {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] volume_backend_name = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] volume_clear = zero {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] volume_clear_ionice = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] volume_clear_size = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] volume_copy_bps_limit = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] volume_dd_blocksize = 1M {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] volume_name_template = volume-%s {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] volume_service_inithost_offload = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] volume_usage_audit_period = month {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] zoning_mode = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_concurrency.disable_process_locking = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.auth_section = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.auth_type = password {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.auth_version = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.cache = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.certfile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.delay_auth_decision = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.http_connect_timeout = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.include_service_catalog = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.insecure = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.interface = public {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.keyfile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.memcache_password = {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.memcache_username = {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.region_name = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.service_token_roles_required = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.service_type = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.token_cache_time = 300 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.14/identity {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.backend = dogpile.cache.null {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.backend_argument = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.backend_expiration_time = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.config_prefix = cache.oslo {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.debug_cache_backend = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.enable_retry_client = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.enable_socket_keepalive = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.enabled = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.expiration_time = 600 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.hashclient_retry_attempts = 2 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.memcache_dead_retry = 300 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.memcache_pool_maxsize = 10 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.memcache_sasl_enabled = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.password = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.proxies = [] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93287]: DEBUG cinder.volume.drivers.quobyte [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93287) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 25 17:00:22 devstack cinder-volume[93287]: WARNING cinder.volume.drivers.quobyte [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 25 17:00:22 devstack cinder-volume[93287]: WARNING cinder.volume.drivers.quobyte [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 25 17:00:22 devstack cinder-volume[93287]: DEBUG oslo_concurrency.processutils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Running cmd (subprocess): mount.quobyte {{(pid=93287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.redis_db = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.redis_sentinel_service_name = mymaster {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.redis_server = localhost:6379 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.retry_attempts = 2 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.retry_delay = 0.0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.socket_keepalive_count = 1 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.socket_keepalive_idle = 1 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.socket_keepalive_interval = 1 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.socket_timeout = 1.0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.tls_allowed_ciphers = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.tls_cafile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.tls_certfile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.tls_enabled = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.tls_keyfile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cache.username = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] coordination.backend_url = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.asyncio_connection = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.asyncio_slave_connection = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.backend = sqlalchemy {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.connection = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.connection_debug = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.connection_parameters = {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.connection_recycle_time = 3600 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.connection_trace = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.db_inc_retry_interval = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.db_max_retries = 20 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.db_max_retry_interval = 10 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.db_retry_interval = 1 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.max_overflow = 50 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.max_pool_size = 5 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.max_retries = 10 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.mysql_wsrep_sync_wait = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.pool_timeout = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.retry_interval = 10 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.slave_connection = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.sqlite_synchronous = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.synchronous_reader = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] database.use_db_reconnect = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] profiler.connection_string = messaging:// {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] profiler.enabled = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] profiler.es_doc_type = notification {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] profiler.es_scroll_size = 10000 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] profiler.es_scroll_time = 2m {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] profiler.filter_error_trace = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] profiler.hmac_keys = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] profiler.sentinel_service_name = mymaster {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] profiler.socket_timeout = 0.1 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] profiler.trace_requests = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] profiler.trace_sqlalchemy = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] profiler_jaeger.process_tags = {} {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] profiler_jaeger.service_name_prefix = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] profiler_otlp.service_name_prefix = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_policy.enforce_new_defaults = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: WARNING oslo_config.cfg [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_policy.enforce_scope = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_policy.policy_default_rule = default {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:22 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_policy.policy_file = policy.yaml {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_policy.remote_timeout = 60.0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] privsep_osbrick.group = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] privsep_osbrick.helper_command = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] privsep_osbrick.user = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cinder_sys_admin.group = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cinder_sys_admin.helper_command = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] cinder_sys_admin.user = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] service_user.auth_section = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] service_user.auth_type = password {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] service_user.cafile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] service_user.certfile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] service_user.collect_timing = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] service_user.insecure = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] service_user.keyfile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] service_user.send_service_user_token = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] service_user.split_loggers = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] service_user.timeout = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance.auth_section = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance.auth_type = password {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance.certfile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance.collect_timing = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance.insecure = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance.keyfile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance.region_name = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance.split_loggers = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] glance.timeout = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.backend_availability_zone = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.chap_password = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.chap_username = {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.disk_geometry = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.driver_client_cert = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.driver_client_cert_key = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.driver_data_namespace = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.driver_use_ssl = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.enable_unsupported_driver = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.extra_capabilities = {} {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.filter_function = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.goodness_function = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.iscsi_target_flags = {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.iscsi_write_cache = on {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.iser_helper = tgtadm {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.iser_ip_address = 192.168.122.14 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.iser_port = 3260 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.nas_host = {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.nas_login = admin {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.nas_mount_options = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.nas_password = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.nas_private_key = {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.nas_share_path = {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.nas_ssh_port = 22 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.num_shell_tries = 3 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.nvmet_port_id = 1 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.quobyte_client_cfg = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.quobyte_volume_url = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.replication_device = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.report_discard_supported = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.reserved_percentage = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.scst_target_driver = iscsi {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.scst_target_iqn_name = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.storage_protocol = iSCSI {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.target_helper = tgtadm {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.target_ip_address = 192.168.122.14 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.target_port = 3260 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.target_protocol = iscsi {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.trace_flags = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.unique_fqdn_network = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.use_chap_auth = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.volume_backend_name = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.volume_clear = zero {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.volume_clear_ionice = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.volume_clear_size = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_reports.file_event_handler = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_reports.log_dir = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.backend_availability_zone = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.backend_host = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.chap_password = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.chap_username = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.chiscsi_conf = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.disk_geometry = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.driver_client_cert = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.driver_client_cert_key = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.driver_data_namespace = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.driver_use_ssl = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.extra_capabilities = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.filter_function = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.goodness_function = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.iscsi_target_flags = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.iscsi_write_cache = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.iser_helper = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.iser_ip_address = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.iser_port = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.iser_target_prefix = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.nas_host = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.nas_login = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.nas_mount_options = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.nas_password = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.nas_private_key = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.nas_share_path = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.nas_ssh_port = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.num_shell_tries = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.nvmet_ns_id = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.nvmet_port_id = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.replication_device = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.report_discard_supported = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.reserved_percentage = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.scst_target_driver = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.storage_protocol = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.target_helper = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.target_ip_address = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.target_port = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.target_prefix = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.target_protocol = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.trace_flags = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.unique_fqdn_network = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.use_chap_auth = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.volume_clear = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.volume_clear_ionice = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.volume_clear_size = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] QuobyteHD.volumes_dir = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.ssl = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.ssl_version = {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_notifications.driver = [] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_notifications.retry = -1 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] oslo_messaging_notifications.transport_url = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] key_manager.fixed_key = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican.barbican_api_version = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican.barbican_endpoint = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican.barbican_endpoint_type = public {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican.barbican_region_name = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican.cafile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican.certfile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican.collect_timing = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican.insecure = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican.keyfile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican.number_of_retries = 60 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican.retry_delay = 1 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican.send_service_user_token = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican.split_loggers = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican.timeout = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican.verify_ssl = True {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican.verify_ssl_path = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican_service_user.auth_section = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican_service_user.auth_type = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican_service_user.cafile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican_service_user.certfile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican_service_user.collect_timing = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican_service_user.insecure = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican_service_user.keyfile = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican_service_user.split_loggers = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] barbican_service_user.timeout = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] vault.approle_role_id = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] vault.approle_secret_id = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] vault.kv_mountpoint = secret {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] vault.kv_path = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] vault.kv_version = 2 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] vault.namespace = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] vault.root_token_id = **** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] vault.ssl_ca_crt_file = None {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] vault.timeout = 60.0 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack quobyte-client[93288]: Reading configuration file: /etc/quobyte/client.cfg Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] vault.use_ssl = False {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:23 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] ******************************************************************************** {{(pid=93071) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 25 17:00:23 devstack quobyte-client[93288]: Invalid parameters found, error: missing mount point. Jun 25 17:00:23 devstack quobyte-client[93288]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 25 17:00:23 devstack quobyte-client[93288]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 25 17:00:23 devstack cinder-volume[93287]: DEBUG oslo_concurrency.processutils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] CMD "mount.quobyte" returned: 1 in 0.175s {{(pid=93287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:00:23 devstack cinder-volume[93287]: DEBUG oslo_concurrency.lockutils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93287) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:00:23 devstack cinder-volume[93287]: DEBUG oslo_concurrency.lockutils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93287) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:00:23 devstack cinder-volume[93287]: DEBUG cinder.volume.drivers.quobyte [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93287) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:00:23 devstack cinder-volume[93287]: INFO cinder.volume.drivers.quobyte [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 ... Jun 25 17:00:23 devstack cinder-volume[93287]: DEBUG oslo_concurrency.processutils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 -c /etc/quobyte/client-cinder.cfg {{(pid=93287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:00:23 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 -c /etc/quobyte/client-cinder.cfg Jun 25 17:00:23 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:00:23 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Jun 25 17:00:23 devstack cinder-volume[93287]: DEBUG oslo_concurrency.processutils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.778s {{(pid=93287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:00:23 devstack cinder-volume[93287]: INFO cinder.volume.drivers.quobyte [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 succeeded Jun 25 17:00:23 devstack cinder-volume[93287]: DEBUG cinder.volume.drivers.quobyte [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93287) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:00:23 devstack cinder-volume[93287]: DEBUG oslo_concurrency.lockutils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.794s {{(pid=93287) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:00:23 devstack cinder-volume[93287]: DEBUG oslo_concurrency.processutils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:00:23 devstack sudo[93363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:00:23 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:00:24 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root Jun 25 17:00:24 devstack cinder-volume[93287]: DEBUG oslo_concurrency.processutils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.674s {{(pid=93287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:00:24 devstack cinder-volume[93287]: INFO cinder.volume.driver [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Driver hasn't implemented _init_vendor_properties() Jun 25 17:00:24 devstack cinder-volume[93287]: DEBUG cinder.volume.driver [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6732444763184, 'free_capacity_gb': 1775.6732444763184, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93287) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 25 17:00:24 devstack cinder-volume[93287]: DEBUG oslo_db.sqlalchemy.engines [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93287) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 17:00:24 devstack cinder-volume[93287]: DEBUG dbcounter [-] [93287] Writer thread running {{(pid=93287) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 25 17:00:24 devstack cinder-volume[93287]: DEBUG cinder.db.api [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Building query based on filter {{(pid=93287) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 25 17:00:24 devstack cinder-volume[93287]: DEBUG cinder.image.image_utils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93287) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 25 17:00:24 devstack cinder-volume[93287]: INFO cinder.keymgr.migration [None req-08835ae5-be32-4c3e-867e-a73cb3d28d54 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 25 17:00:24 devstack cinder-volume[93287]: DEBUG oslo_concurrency.lockutils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93287) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:00:24 devstack cinder-volume[93287]: DEBUG oslo_concurrency.lockutils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93287) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:00:24 devstack cinder-volume[93287]: DEBUG cinder.volume.drivers.quobyte [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93287) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:00:24 devstack cinder-volume[93287]: DEBUG cinder.volume.drivers.quobyte [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93287) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:00:24 devstack cinder-volume[93287]: DEBUG oslo_concurrency.lockutils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93287) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:00:24 devstack cinder-volume[93287]: DEBUG oslo_concurrency.processutils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:00:24 devstack sudo[93366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:00:24 devstack sudo[93366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:00:25 devstack sudo[93366]: pam_unix(sudo:session): session closed for user root Jun 25 17:00:25 devstack cinder-volume[93287]: DEBUG oslo_concurrency.processutils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.789s {{(pid=93287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:00:25 devstack cinder-volume[93287]: DEBUG cinder.manager [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Notifying Schedulers of capabilities ... {{(pid=93287) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:00:25 devstack cinder-volume[93287]: INFO cinder.volume.manager [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Driver initialization completed successfully. Jun 25 17:00:25 devstack cinder-volume[93287]: INFO cinder.manager [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Initiating service 3 cleanup Jun 25 17:00:25 devstack cinder-volume[93287]: INFO cinder.manager [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Service 3 cleanup completed. Jun 25 17:00:25 devstack cinder-volume[93287]: DEBUG cinder.service [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Creating RPC server for service cinder-volume {{(pid=93287) start /opt/stack/cinder/cinder/service.py:231}} Jun 25 17:00:25 devstack cinder-volume[93287]: DEBUG cinder.service [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93287) start /opt/stack/cinder/cinder/service.py:237}} Jun 25 17:00:25 devstack cinder-volume[93287]: INFO cinder.volume.manager [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 25 17:00:25 devstack cinder-volume[93287]: DEBUG oslo_concurrency.lockutils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93287) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:00:25 devstack cinder-volume[93287]: DEBUG oslo_concurrency.lockutils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93287) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:00:25 devstack cinder-volume[93287]: DEBUG cinder.volume.drivers.quobyte [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93287) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:00:25 devstack cinder-volume[93287]: DEBUG cinder.volume.drivers.quobyte [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93287) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:00:25 devstack cinder-volume[93287]: DEBUG oslo_concurrency.lockutils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93287) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:00:25 devstack cinder-volume[93287]: DEBUG oslo_concurrency.processutils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:00:25 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:00:25 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:00:26 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Jun 25 17:00:26 devstack cinder-volume[93287]: DEBUG oslo_concurrency.processutils [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.922s {{(pid=93287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:00:26 devstack cinder-volume[93287]: INFO cinder.volume.manager [None req-810a229c-2069-47d1-be65-6c782b42f450 None None] Driver post RPC initialization completed successfully. Jun 25 17:00:30 devstack cinder-volume[93287]: DEBUG oslo_concurrency.lockutils [None req-6e5ab3e5-1c49-44c7-84b2-5875cc21f7b3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93287) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:00:30 devstack cinder-volume[93287]: DEBUG oslo_concurrency.lockutils [None req-6e5ab3e5-1c49-44c7-84b2-5875cc21f7b3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93287) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:00:30 devstack cinder-volume[93287]: DEBUG cinder.volume.drivers.quobyte [None req-6e5ab3e5-1c49-44c7-84b2-5875cc21f7b3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93287) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:00:30 devstack cinder-volume[93287]: DEBUG cinder.volume.drivers.quobyte [None req-6e5ab3e5-1c49-44c7-84b2-5875cc21f7b3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93287) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:00:30 devstack cinder-volume[93287]: DEBUG oslo_concurrency.lockutils [None req-6e5ab3e5-1c49-44c7-84b2-5875cc21f7b3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93287) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:00:30 devstack cinder-volume[93287]: DEBUG oslo_concurrency.processutils [None req-6e5ab3e5-1c49-44c7-84b2-5875cc21f7b3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:00:30 devstack sudo[93487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:00:30 devstack sudo[93487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:00:30 devstack sudo[93487]: pam_unix(sudo:session): session closed for user root Jun 25 17:00:30 devstack cinder-volume[93287]: DEBUG oslo_concurrency.processutils [None req-6e5ab3e5-1c49-44c7-84b2-5875cc21f7b3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.722s {{(pid=93287) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:00:30 devstack cinder-volume[93287]: DEBUG cinder.manager [None req-6e5ab3e5-1c49-44c7-84b2-5875cc21f7b3 None None] Notifying Schedulers of capabilities ... {{(pid=93287) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:00:32 devstack cinder-volume[93071]: DEBUG dbcounter [-] [93071] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=93071) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:00:33 devstack cinder-volume[93071]: INFO oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Caught SIGTERM, stopping children Jun 25 17:00:33 devstack cinder-volume[93071]: DEBUG oslo_concurrency.lockutils [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Acquiring lock "singleton_lock" {{(pid=93071) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 17:00:33 devstack cinder-volume[93071]: DEBUG oslo_concurrency.lockutils [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Acquired lock "singleton_lock" {{(pid=93071) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 17:00:33 devstack cinder-volume[93071]: DEBUG oslo_concurrency.lockutils [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Releasing lock "singleton_lock" {{(pid=93071) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 17:00:33 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Stop services. {{(pid=93071) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 25 17:00:33 devstack cinder-volume[93071]: DEBUG oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Killing children. {{(pid=93071) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 25 17:00:33 devstack cinder-volume[93071]: INFO oslo_service.backend._eventlet.service [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Waiting on 1 children to exit Jun 25 17:00:36 devstack cinder-volume[93287]: DEBUG dbcounter [-] [93287] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=93287) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:00:36 devstack cinder-volume[93287]: DEBUG dbcounter [-] [93287] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=93287) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:00:38 devstack cinder-volume[93287]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 25 17:00:38 devstack cinder-volume[93577]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 25 17:00:38 devstack cinder-volume[93577]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 17:00:38 devstack cinder-volume[93577]: we strongly recommend against using it for new projects. Jun 25 17:00:38 devstack cinder-volume[93577]: If you are already using Eventlet, we recommend migrating to a different Jun 25 17:00:38 devstack cinder-volume[93577]: framework. For more detail see Jun 25 17:00:38 devstack cinder-volume[93577]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 17:00:38 devstack cinder-volume[93577]: import eventlet # noqa Jun 25 17:00:39 devstack cinder-volume[93287]: DEBUG oslo_concurrency.lockutils [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Acquiring lock "singleton_lock" {{(pid=93287) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 17:00:39 devstack cinder-volume[93287]: DEBUG oslo_concurrency.lockutils [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Acquired lock "singleton_lock" {{(pid=93287) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 17:00:39 devstack cinder-volume[93287]: DEBUG oslo_concurrency.lockutils [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Releasing lock "singleton_lock" {{(pid=93287) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 17:00:39 devstack cinder-volume[93287]: WARNING amqp [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 25 17:00:39 devstack cinder-volume[93287]: WARNING amqp [None req-65273302-b223-4f79-81e4-c9a848586d8c None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 25 17:00:41 devstack cinder-volume[93577]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93577) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 25 17:00:41 devstack cinder-volume[93577]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93577) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 25 17:00:41 devstack cinder-volume[93577]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93577) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 25 17:00:41 devstack cinder-volume[93577]: INFO dbcounter [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] Registered counter for database cinder Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_db.sqlalchemy.engines [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93577) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG dbcounter [-] [93577] Writer thread running {{(pid=93577) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 25 17:00:42 devstack cinder-volume[93577]: INFO cinder.rpc [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 25 17:00:42 devstack cinder-volume[93577]: INFO cinder.rpc [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_db.sqlalchemy.engines [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93577) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 17:00:42 devstack cinder-volume[93577]: INFO cinder.volume.manager [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] Determined volume DB was empty at startup. Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG cinder.volume.manager [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93577) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 25 17:00:42 devstack cinder-volume[93577]: WARNING stevedore.named [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 25 17:00:42 devstack cinder-volume[93577]: WARNING castellan.key_manager [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 17:00:42 devstack cinder-volume[93577]: WARNING cinder.keymgr.conf_key_mgr [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 25 17:00:42 devstack cinder-volume[93577]: INFO cinder.volume.manager [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_db.sqlalchemy.engines [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93577) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 17:00:42 devstack cinder-volume[93577]: INFO oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] Starting 1 workers Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] Started child 93869 {{(pid=93577) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] Full set of CONF: {{(pid=93577) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] ******************************************************************************** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] Configuration options gathered from: {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] ================================================================================ {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] allow_availability_zone_fallback = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] allow_compression_on_image_upload = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] allowed_direct_url_schemes = [] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] api_rate_limit = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93869]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] auth_strategy = keystone {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_availability_zone = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_host = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_name = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_stats_polling_interval = 60 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backup_api_class = cinder.backup.api.API {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backup_name_template = backup-%s {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backup_use_same_host = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backup_use_temp_snapshot = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] chap_password = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] chap_username = {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cinder_internal_tenant_project_id = ef848515402d42509987630cfdabfb3c {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cinder_internal_tenant_user_id = 2f980ffbadd6470db318451856c7b46d {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cluster = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] compression_format = gzip {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] compute_api_class = cinder.compute.nova.API {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] config_dir = [] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] config_source = [] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] control_exchange = openstack {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] debug = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] default_availability_zone = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] default_group_type = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] default_volume_type = QuobyteHD {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] disk_geometry = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] driver_client_cert = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] driver_client_cert_key = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] driver_data_namespace = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] driver_ssl_cert_path = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] driver_ssl_cert_verify = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] driver_use_ssl = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] enable_new_services = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] enable_unsupported_driver = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] enabled_backends = ['QuobyteHD'] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] enforce_multipath_for_image_xfer = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] filter_function = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance_api_insecure = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance_api_servers = ['http://192.168.122.14/image'] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance_api_ssl_compression = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance_ca_certificates_file = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance_catalog_info = image:glance:publicURL {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance_certfile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance_keyfile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance_num_retries = 3 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance_request_timeout = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] goodness_function = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] graceful_shutdown_timeout = 5 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] group_api_class = cinder.group.api.API {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] host = devstack {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] image_compress_on_upload = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] image_conversion_address_space_limit = 1 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] image_conversion_cpu_limit = 60 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] image_conversion_disable = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] image_upload_use_cinder_backend = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] image_upload_use_internal_tenant = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] image_volume_cache_enabled = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] image_volume_cache_max_count = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] image_volume_cache_max_size_gb = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] init_host_max_objects_retrieval = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] instance_format = [instance: %(uuid)s] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] iscsi_target_flags = {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] iscsi_write_cache = on {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] iser_helper = tgtadm {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] iser_ip_address = 192.168.122.14 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] iser_port = 3260 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] log_color = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] log_config_append = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] log_dir = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] log_file = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] log_options = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] log_rotate_interval = 1 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] log_rotate_interval_type = days {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] log_rotation_type = none {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] max_age = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] max_logfile_count = 30 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] max_logfile_size_mb = 200 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] max_over_subscription_ratio = 20.0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] message_reap_interval = 86400 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] message_ttl = 2592000 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] migration_create_volume_timeout_secs = 300 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] monkey_patch = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] monkey_patch_modules = [] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] my_ip = 192.168.122.14 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] no_snapshot_gb_quota = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] num_iser_scan_tries = 3 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] num_shell_tries = 3 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] num_volume_device_scan_tries = 3 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] nvmeof_conn_info_version = 1 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] nvmet_ns_id = 10 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] nvmet_port_id = 1 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] osapi_max_limit = 1000 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] osapi_volume_ext_list = [] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] osapi_volume_listen_port = 8776 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] osapi_volume_use_ssl = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] osapi_volume_workers = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93869) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] per_volume_size_limit = -1 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] periodic_fuzzy_delay = 60 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] periodic_interval = 60 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] public_endpoint = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] publish_errors = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] quota_backup_gigabytes = 1000 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] quota_backups = 10 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] quota_gigabytes = 1000 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] quota_groups = 10 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] quota_snapshots = 10 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] quota_volumes = 10 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] rate_limit_burst = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] rate_limit_except_level = CRITICAL {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] rate_limit_interval = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] reinit_driver_count = 3 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] replication_device = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] report_discard_supported = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] report_interval = 120 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] reservation_clean_interval = 86400 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] reservation_expire = 86400 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] reserved_image_namespaces = [] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] reserved_percentage = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] rpc_response_timeout = 120 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] run_external_periodic_tasks = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] scst_target_driver = iscsi {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] scst_target_iqn_name = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] service_down_time = 720 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] shell_completion = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] snapshot_name_template = snapshot-%s {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] split_loggers = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] state_path = /opt/stack/data/cinder {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] storage_availability_zone = nova {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] storage_protocol = iSCSI {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] syslog_log_facility = LOG_USER {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] target_helper = lioadm {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] target_ip_address = 192.168.122.14 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] target_port = 3260 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] target_protocol = iscsi {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] target_secondary_ip_addresses = [] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] trace_flags = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] transport_url = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] until_refresh = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] use_chap_auth = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] use_default_quota_class = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] use_journal = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] use_json = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] use_multipath_for_image_xfer = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] use_stderr = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] use_syslog = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] verify_glance_signatures = enabled {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] volume_api_class = cinder.volume.api.API {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] volume_backend_name = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] volume_clear = zero {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] volume_clear_ionice = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] volume_clear_size = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] volume_copy_bps_limit = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] volume_dd_blocksize = 1M {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] volume_name_template = volume-%s {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] volume_service_inithost_offload = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] volume_usage_audit_period = month {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] zoning_mode = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_concurrency.disable_process_locking = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.auth_section = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.auth_type = password {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.auth_version = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.cache = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.certfile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.include_service_catalog = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.insecure = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.interface = public {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.keyfile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.memcache_password = {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.memcache_username = {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.region_name = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.service_type = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.14/identity {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.backend = dogpile.cache.null {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.backend_argument = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.backend_expiration_time = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.config_prefix = cache.oslo {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.debug_cache_backend = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.enable_retry_client = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.enable_socket_keepalive = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.enabled = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.expiration_time = 600 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.hashclient_retry_attempts = 2 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.memcache_dead_retry = 300 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.memcache_pool_maxsize = 10 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.memcache_sasl_enabled = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.password = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.proxies = [] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.redis_db = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.redis_server = localhost:6379 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.retry_attempts = 2 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.retry_delay = 0.0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.socket_keepalive_count = 1 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.socket_keepalive_idle = 1 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.socket_keepalive_interval = 1 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.socket_timeout = 1.0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.tls_allowed_ciphers = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.tls_cafile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.tls_certfile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.tls_enabled = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.tls_keyfile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cache.username = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] coordination.backend_url = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.asyncio_connection = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.asyncio_slave_connection = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.backend = sqlalchemy {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.connection = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93869) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 25 17:00:42 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.quobyte [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 25 17:00:42 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.quobyte [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.connection_debug = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.connection_parameters = {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.connection_recycle_time = 3600 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.connection_trace = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.db_inc_retry_interval = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.db_max_retries = 20 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.db_max_retry_interval = 10 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.db_retry_interval = 1 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.max_overflow = 50 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.max_pool_size = 5 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.max_retries = 10 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Running cmd (subprocess): mount.quobyte {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.mysql_wsrep_sync_wait = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.pool_timeout = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.retry_interval = 10 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.slave_connection = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.sqlite_synchronous = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.synchronous_reader = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] database.use_db_reconnect = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] profiler.connection_string = messaging:// {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] profiler.enabled = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] profiler.es_doc_type = notification {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] profiler.es_scroll_size = 10000 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] profiler.es_scroll_time = 2m {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] profiler.filter_error_trace = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] profiler.hmac_keys = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] profiler.sentinel_service_name = mymaster {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] profiler.socket_timeout = 0.1 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] profiler.trace_requests = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] profiler.trace_sqlalchemy = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] profiler_jaeger.process_tags = {} {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] profiler_jaeger.service_name_prefix = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] profiler_otlp.service_name_prefix = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_policy.enforce_new_defaults = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: WARNING oslo_config.cfg [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_policy.enforce_scope = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_policy.policy_default_rule = default {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_policy.policy_file = policy.yaml {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] privsep_osbrick.group = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] privsep_osbrick.helper_command = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] privsep_osbrick.user = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cinder_sys_admin.group = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cinder_sys_admin.helper_command = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] cinder_sys_admin.user = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] service_user.auth_section = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] service_user.auth_type = password {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] service_user.cafile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] service_user.certfile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] service_user.collect_timing = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] service_user.insecure = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] service_user.keyfile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] service_user.send_service_user_token = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] service_user.split_loggers = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] service_user.timeout = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance.auth_section = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance.auth_type = password {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance.certfile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance.collect_timing = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance.insecure = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance.keyfile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance.region_name = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance.split_loggers = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] glance.timeout = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.backend_availability_zone = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.chap_password = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.chap_username = {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.disk_geometry = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.driver_client_cert = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.driver_client_cert_key = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.driver_data_namespace = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.driver_use_ssl = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.extra_capabilities = {} {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.filter_function = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.goodness_function = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.iscsi_target_flags = {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.iscsi_write_cache = on {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.iser_helper = tgtadm {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.iser_ip_address = 192.168.122.14 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.iser_port = 3260 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.nas_host = {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.nas_login = admin {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.nas_mount_options = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.nas_password = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.nas_private_key = {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.nas_share_path = {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.num_shell_tries = 3 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.quobyte_volume_url = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.replication_device = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.report_discard_supported = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.reserved_percentage = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.target_helper = tgtadm {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.target_ip_address = 192.168.122.14 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.target_port = 3260 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.target_protocol = iscsi {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.trace_flags = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.unique_fqdn_network = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.use_chap_auth = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack quobyte-client[93870]: Reading configuration file: /etc/quobyte/client.cfg Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.volume_backend_name = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.volume_clear = zero {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.volume_clear_ionice = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.volume_clear_size = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack quobyte-client[93870]: Invalid parameters found, error: missing mount point. Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack quobyte-client[93870]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack quobyte-client[93870]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 25 17:00:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_reports.file_event_handler = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_reports.log_dir = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.backend_availability_zone = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.backend_host = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.chap_password = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.chap_username = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.chiscsi_conf = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.disk_geometry = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.driver_client_cert = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.driver_data_namespace = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.driver_use_ssl = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.extra_capabilities = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.filter_function = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.goodness_function = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.iser_helper = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.iser_ip_address = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.iser_port = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.iser_target_prefix = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.nas_host = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.nas_login = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.nas_mount_options = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.nas_password = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.nas_private_key = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.nas_share_path = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.nas_ssh_port = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.num_shell_tries = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.nvmet_port_id = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.replication_device = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.report_discard_supported = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.reserved_percentage = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.scst_target_driver = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.storage_protocol = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.target_helper = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.target_ip_address = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.target_port = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.target_prefix = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.target_protocol = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.trace_flags = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.use_chap_auth = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.volume_clear = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.volume_clear_size = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] QuobyteHD.volumes_dir = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:00:42 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.ssl = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_notifications.driver = [] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_notifications.retry = -1 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] key_manager.fixed_key = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican.barbican_api_version = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican.barbican_endpoint = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican.barbican_endpoint_type = public {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican.barbican_region_name = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican.cafile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican.certfile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican.collect_timing = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican.insecure = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican.keyfile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican.number_of_retries = 60 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican.retry_delay = 1 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican.send_service_user_token = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican.split_loggers = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican.timeout = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican.verify_ssl = True {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican.verify_ssl_path = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican_service_user.auth_section = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican_service_user.auth_type = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican_service_user.cafile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican_service_user.certfile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican_service_user.collect_timing = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican_service_user.insecure = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican_service_user.keyfile = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican_service_user.split_loggers = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] barbican_service_user.timeout = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] vault.approle_role_id = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] vault.approle_secret_id = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] vault.kv_mountpoint = secret {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] vault.kv_path = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] vault.kv_version = 2 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] vault.namespace = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] vault.root_token_id = **** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] vault.ssl_ca_crt_file = None {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] vault.timeout = 60.0 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] vault.use_ssl = False {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 25 17:00:42 devstack cinder-volume[93577]: DEBUG oslo_service.backend._eventlet.service [None req-4154c05f-74c0-4478-858c-b99ac2f43344 None None] ******************************************************************************** {{(pid=93577) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 25 17:00:43 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Jun 25 17:00:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.698s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:00:43 devstack cinder-volume[93869]: INFO cinder.volume.driver [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Driver hasn't implemented _init_vendor_properties() Jun 25 17:00:43 devstack cinder-volume[93869]: DEBUG cinder.volume.driver [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6732444763184, 'free_capacity_gb': 1775.6732444763184, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93869) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 25 17:00:43 devstack cinder-volume[93869]: DEBUG oslo_db.sqlalchemy.engines [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93869) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 25 17:00:43 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writer thread running {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 25 17:00:43 devstack cinder-volume[93869]: DEBUG cinder.db.api [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Building query based on filter {{(pid=93869) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 25 17:00:43 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93869) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 25 17:00:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:00:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:00:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:00:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:00:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:00:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:00:43 devstack cinder-volume[93869]: INFO cinder.keymgr.migration [None req-70137a25-6af0-426c-b2b0-2204fff6bfcd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 25 17:00:43 devstack sudo[93903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:00:43 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:00:44 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root Jun 25 17:00:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.638s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:00:44 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:00:44 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Driver initialization completed successfully. Jun 25 17:00:44 devstack cinder-volume[93869]: INFO cinder.manager [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Initiating service 3 cleanup Jun 25 17:00:44 devstack cinder-volume[93869]: INFO cinder.manager [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Service 3 cleanup completed. Jun 25 17:00:44 devstack cinder-volume[93869]: DEBUG cinder.service [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Creating RPC server for service cinder-volume {{(pid=93869) start /opt/stack/cinder/cinder/service.py:231}} Jun 25 17:00:44 devstack cinder-volume[93869]: DEBUG cinder.service [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93869) start /opt/stack/cinder/cinder/service.py:237}} Jun 25 17:00:44 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 25 17:00:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:00:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:00:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:00:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:00:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:00:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:00:44 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:00:44 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:00:45 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Jun 25 17:00:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.651s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:00:45 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-deeec8b8-7b22-466e-9b15-8409306e1636 None None] Driver post RPC initialization completed successfully. Jun 25 17:00:52 devstack cinder-volume[93577]: DEBUG dbcounter [-] [93577] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93577) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:00:54 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:00:55 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=3 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:01:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:01:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:01:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:01:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:01:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:01:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:01:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:01:44 devstack sudo[94377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:01:44 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:01:45 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root Jun 25 17:01:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.923s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:01:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:01:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:01:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 6 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:01:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Flow 'volume_create_manager' (cd74aeac-1aa5-480b-84e9-9efe8cd357e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d025c38-4aa6-420c-af30-8a765245da12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d025c38-4aa6-420c-af30-8a765245da12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-890388335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9dc9436-d833-47f9-a50d-ca7ad64ed9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b64be701960747b4825a02c6b8c00970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:02:04Z,use_quota=True,user_id='c312f1bd15da4d3eb6a425c4dea36dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b67c0ec-81fd-4ac4-8d91-93806facf114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b67c0ec-81fd-4ac4-8d91-93806facf114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e01744-4c4a-4db5-90b6-9e039f25c3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e01744-4c4a-4db5-90b6-9e039f25c3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9dc9436-d833-47f9-a50d-ca7ad64ed9f0', 'volume_name': 'volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534b62c4-1832-4b69-baeb-c6a3e890a8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534b62c4-1832-4b69-baeb-c6a3e890a8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66ed2d01-b36c-4bb9-b16d-708c97361599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:04 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Volume b9dc9436-d833-47f9-a50d-ca7ad64ed9f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0', 'volume_size': 1} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-890388335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9dc9436-d833-47f9-a50d-ca7ad64ed9f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b64be701960747b4825a02c6b8c00970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:02:04Z,use_quota=True,user_id='c312f1bd15da4d3eb6a425c4dea36dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Creating volume b9dc9436-d833-47f9-a50d-ca7ad64ed9f0 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:02:04 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:02:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:02:04 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0 1073741824 Jun 25 17:02:04 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:07 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0 1073741824" returned: 0 in 2.375s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:02:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:02:07 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0 Jun 25 17:02:07 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:09 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0" returned: 0 in 1.891s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:02:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] <== create_volume: return (4428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:02:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.433s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:02:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66ed2d01-b36c-4bb9-b16d-708c97361599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042be9ea-4ab5-4f70-983a-aba3953a2726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:09 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Volume volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0 (b9dc9436-d833-47f9-a50d-ca7ad64ed9f0): created successfully Jun 25 17:02:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042be9ea-4ab5-4f70-983a-aba3953a2726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Flow 'volume_create_manager' (cd74aeac-1aa5-480b-84e9-9efe8cd357e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:02:09 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-2b81599c-8489-4d28-a94f-cda0e0b085a9 tempest-DeleteServersTestJSON-1857807940 None] Created volume successfully. Jun 25 17:02:18 devstack cinder-volume[93869]: WARNING py.warnings [req-3bcf7b91-568e-4400-8e72-07cede472c49 req-33e8819d-627d-4b2c-8206-f20f7ab8509c tempest-DeleteServersTestJSON-1857807940 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jun 25 17:02:18 devstack cinder-volume[93869]: .first() Jun 25 17:02:18 devstack cinder-volume[93869]: Jun 25 17:02:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-3bcf7b91-568e-4400-8e72-07cede472c49 req-33e8819d-627d-4b2c-8206-f20f7ab8509c tempest-DeleteServersTestJSON-1857807940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:02:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-3bcf7b91-568e-4400-8e72-07cede472c49 req-33e8819d-627d-4b2c-8206-f20f7ab8509c tempest-DeleteServersTestJSON-1857807940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:02:18 devstack cinder-volume[93869]: INFO oslo.privsep.daemon [req-3bcf7b91-568e-4400-8e72-07cede472c49 req-33e8819d-627d-4b2c-8206-f20f7ab8509c tempest-DeleteServersTestJSON-1857807940 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_p3h8na6/privsep.sock'] Jun 25 17:02:18 devstack sudo[95178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_p3h8na6/privsep.sock Jun 25 17:02:18 devstack sudo[95178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:18 devstack cinder-volume[93869]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 25 17:02:18 devstack cinder-volume[93869]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 17:02:18 devstack cinder-volume[93869]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 25 17:02:18 devstack cinder-volume[93869]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 17:02:18 devstack cinder-volume[93869]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 25 17:02:18 devstack cinder-volume[93869]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 25 17:02:18 devstack cinder-volume[93869]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 17:02:18 devstack cinder-volume[93869]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 17:02:18 devstack cinder-volume[93869]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 25 17:02:19 devstack cinder-volume[93869]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 25 17:02:19 devstack cinder-volume[93869]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 25 17:02:19 devstack cinder-volume[93869]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 25 17:02:19 devstack cinder-volume[93869]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 17:02:19 devstack cinder-volume[93869]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 25 17:02:19 devstack cinder-volume[93869]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 25 17:02:19 devstack cinder-volume[93869]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 25 17:02:19 devstack cinder-volume[93869]: WARNING oslo.privsep.daemon [-] privsep log: Jun 25 17:02:19 devstack cinder-volume[93869]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 25 17:02:20 devstack sudo[95178]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:20 devstack cinder-volume[93869]: INFO oslo.privsep.daemon [req-3bcf7b91-568e-4400-8e72-07cede472c49 req-33e8819d-627d-4b2c-8206-f20f7ab8509c tempest-DeleteServersTestJSON-1857807940 None] Spawned new privsep daemon via rootwrap Jun 25 17:02:20 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [req-3bcf7b91-568e-4400-8e72-07cede472c49 req-33e8819d-627d-4b2c-8206-f20f7ab8509c tempest-DeleteServersTestJSON-1857807940 None] Accepted privsep connection to /tmp/tmp_p3h8na6/privsep.sock {{(pid=93869) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 25 17:02:20 devstack cinder-volume[93869]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 25 17:02:20 devstack cinder-volume[93869]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 25 17:02:20 devstack cinder-volume[93869]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 25 17:02:20 devstack cinder-volume[93869]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 95215 Jun 25 17:02:20 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[062e735c-457c-4822-a6b5-91705f804dfb]: (2,) {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:02:20 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d280955e-c0fa-4555-be49-f8ef7f1ed00d]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:02:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-3bcf7b91-568e-4400-8e72-07cede472c49 req-33e8819d-627d-4b2c-8206-f20f7ab8509c tempest-DeleteServersTestJSON-1857807940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:02:20 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0 Jun 25 17:02:20 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:21 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-3bcf7b91-568e-4400-8e72-07cede472c49 req-33e8819d-627d-4b2c-8206-f20f7ab8509c tempest-DeleteServersTestJSON-1857807940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0" returned: 0 in 1.085s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:02:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-3bcf7b91-568e-4400-8e72-07cede472c49 req-33e8819d-627d-4b2c-8206-f20f7ab8509c tempest-DeleteServersTestJSON-1857807940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.243s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:02:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-3bcf7b91-568e-4400-8e72-07cede472c49 req-33e8819d-627d-4b2c-8206-f20f7ab8509c tempest-DeleteServersTestJSON-1857807940 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b9f8581-1fff-4938-8b91-0e2a2dd35bb4', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:02:21 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-3bcf7b91-568e-4400-8e72-07cede472c49 req-33e8819d-627d-4b2c-8206-f20f7ab8509c tempest-DeleteServersTestJSON-1857807940 None] attachment_update completed successfully. Jun 25 17:02:31 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=5,cinder:SELECT=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:02:31 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:02:33 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-bd923ecf-d0f2-474c-ac82-f2186bfa39c7 req-3d69db96-a9ae-4099-a1dd-eba21a84f40f tempest-DeleteServersTestJSON-1857807940 None] Terminate volume connection completed successfully. Jun 25 17:02:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-bd923ecf-d0f2-474c-ac82-f2186bfa39c7 req-3d69db96-a9ae-4099-a1dd-eba21a84f40f tempest-DeleteServersTestJSON-1857807940 None] Deleting attachment 9b9f8581-1fff-4938-8b91-0e2a2dd35bb4. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Flow 'volume_create_manager' (159b12a5-c108-4d31-b5ac-cef37762ffc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abce5ef-5cb4-430c-9ac0-510d2b48c203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abce5ef-5cb4-430c-9ac0-510d2b48c203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2030836471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843648a6-e921-4fc2-aa8b-8b7da51347cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709e0b8268e64cb0afeea10a3704b2a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:02:35Z,use_quota=True,user_id='5af31fab3d4b48c6a00d55f2e659ed60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d45badf-7f68-4b8e-903c-cc80c88d3df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d45badf-7f68-4b8e-903c-cc80c88d3df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c79b2ce-7160-48dd-b696-b8642fd82920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c79b2ce-7160-48dd-b696-b8642fd82920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '843648a6-e921-4fc2-aa8b-8b7da51347cd', 'volume_name': 'volume-843648a6-e921-4fc2-aa8b-8b7da51347cd', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669a4bcb-376d-40ee-98f2-f10e8b9aba83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669a4bcb-376d-40ee-98f2-f10e8b9aba83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397215ee-4d67-4068-934a-5232a0f30bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:34 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Volume 843648a6-e921-4fc2-aa8b-8b7da51347cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-843648a6-e921-4fc2-aa8b-8b7da51347cd', 'volume_size': 1} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2030836471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843648a6-e921-4fc2-aa8b-8b7da51347cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709e0b8268e64cb0afeea10a3704b2a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:02:35Z,use_quota=True,user_id='5af31fab3d4b48c6a00d55f2e659ed60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Creating volume 843648a6-e921-4fc2-aa8b-8b7da51347cd {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:02:34 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:02:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-843648a6-e921-4fc2-aa8b-8b7da51347cd 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:02:34 devstack sudo[95780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-843648a6-e921-4fc2-aa8b-8b7da51347cd 1073741824 Jun 25 17:02:34 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:35 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-843648a6-e921-4fc2-aa8b-8b7da51347cd 1073741824" returned: 0 in 1.042s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:02:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-843648a6-e921-4fc2-aa8b-8b7da51347cd {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:02:36 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-843648a6-e921-4fc2-aa8b-8b7da51347cd Jun 25 17:02:36 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:36 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-843648a6-e921-4fc2-aa8b-8b7da51347cd" returned: 0 in 0.884s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:02:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:02:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:02:37 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (397215ee-4d67-4068-934a-5232a0f30bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-843648a6-e921-4fc2-aa8b-8b7da51347cd', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:37 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8652a1dc-63d4-4cb6-93cc-f7ad4236bfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:37 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Volume volume-843648a6-e921-4fc2-aa8b-8b7da51347cd (843648a6-e921-4fc2-aa8b-8b7da51347cd): created successfully Jun 25 17:02:37 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8652a1dc-63d4-4cb6-93cc-f7ad4236bfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:37 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Flow 'volume_create_manager' (159b12a5-c108-4d31-b5ac-cef37762ffc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:02:37 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-47fab6b7-1694-458d-9430-c9b2638797c0 tempest-ServersNegativeTestJSON-1151297991 None] Created volume successfully. Jun 25 17:02:37 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] Acquiring lock "cinder-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:02:37 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] Lock "cinder-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:02:37 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] Acquiring lock "cinder-quobyte-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:02:37 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] Lock "cinder-quobyte-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0" acquired by "delete_volume" :: waited 0.028s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:02:37 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[443c173e-fbfa-4edb-be7d-1e73bb7d79df]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:02:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:02:37 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0 Jun 25 17:02:37 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:38 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0" returned: 0 in 1.001s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:02:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:02:38 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0 Jun 25 17:02:38 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Flow 'volume_create_manager' (6509e6b6-c4e7-4c6b-a8ca-92964d797fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227f92c8-9ea2-4ed7-9274-4fd573f42251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (227f92c8-9ea2-4ed7-9274-4fd573f42251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-94699024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bfb172d-6014-4aa5-ac26-0521d91c5191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709e0b8268e64cb0afeea10a3704b2a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:02:40Z,use_quota=True,user_id='5af31fab3d4b48c6a00d55f2e659ed60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e0067c-f3a0-4cc0-ba28-b3811994e442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01e0067c-f3a0-4cc0-ba28-b3811994e442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dee18d6-453f-4616-916a-f02faec0da4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dee18d6-453f-4616-916a-f02faec0da4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bfb172d-6014-4aa5-ac26-0521d91c5191', 'volume_name': 'volume-7bfb172d-6014-4aa5-ac26-0521d91c5191', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba0b97c-3859-4534-accf-4cbe40f37be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba0b97c-3859-4534-accf-4cbe40f37be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e048c9-f1ea-4e90-a2be-f8ab1d1ef55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:39 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Volume 7bfb172d-6014-4aa5-ac26-0521d91c5191: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bfb172d-6014-4aa5-ac26-0521d91c5191', 'volume_size': 1} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-94699024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bfb172d-6014-4aa5-ac26-0521d91c5191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709e0b8268e64cb0afeea10a3704b2a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:02:40Z,use_quota=True,user_id='5af31fab3d4b48c6a00d55f2e659ed60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Creating volume 7bfb172d-6014-4aa5-ac26-0521d91c5191 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:02:39 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7bfb172d-6014-4aa5-ac26-0521d91c5191 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:02:39 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0" returned: 0 in 0.940s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:02:39 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7bfb172d-6014-4aa5-ac26-0521d91c5191 1073741824 Jun 25 17:02:39 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] Lock "cinder-quobyte-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0" released by "delete_volume" :: held 2.020s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:02:39 devstack cinder-volume[93869]: WARNING cinder.quota [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:02:39 devstack cinder-volume[93869]: WARNING cinder.quota [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:02:39 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] Created reservations ['5fed518f-cd06-41a5-a071-b6d8bbb6fe75', 'b3575ec3-8cf6-4948-ada0-468f9c02414a', 'e78db17b-c612-4eae-8acf-d2e97851cc63', '92120e38-1126-4687-97ab-a1bc512a55ce'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:02:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:02:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:02:40 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:02:40 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:02:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:02:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:02:40 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:02:40 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:40 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.805s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:02:40 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:02:40 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] Deleted volume successfully. Jun 25 17:02:40 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d63bd66b-2410-4608-8e21-f836234c2bf7 tempest-DeleteServersTestJSON-1857807940 None] Lock "cinder-b9dc9436-d833-47f9-a50d-ca7ad64ed9f0-delete_volume" released by "delete_volume" :: held 3.260s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:02:40 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7bfb172d-6014-4aa5-ac26-0521d91c5191 1073741824" returned: 0 in 1.233s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:02:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7bfb172d-6014-4aa5-ac26-0521d91c5191 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:02:41 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7bfb172d-6014-4aa5-ac26-0521d91c5191 Jun 25 17:02:41 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:41 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7bfb172d-6014-4aa5-ac26-0521d91c5191" returned: 0 in 0.865s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:02:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] <== create_volume: return (2153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:02:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.156s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:02:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e048c9-f1ea-4e90-a2be-f8ab1d1ef55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bfb172d-6014-4aa5-ac26-0521d91c5191', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28223f4-3210-488b-8a5a-1659a1554bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:41 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Volume volume-7bfb172d-6014-4aa5-ac26-0521d91c5191 (7bfb172d-6014-4aa5-ac26-0521d91c5191): created successfully Jun 25 17:02:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28223f4-3210-488b-8a5a-1659a1554bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Flow 'volume_create_manager' (6509e6b6-c4e7-4c6b-a8ca-92964d797fda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:02:42 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-2545aa87-19a6-48ee-9bec-0a56aee3c1cf tempest-ServersNegativeTestJSON-1151297991 None] Created volume successfully. Jun 25 17:02:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:02:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:02:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:02:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:02:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:02:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:02:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:02:44 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:02:44 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] Acquiring lock "cinder-7bfb172d-6014-4aa5-ac26-0521d91c5191-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:02:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] Lock "cinder-7bfb172d-6014-4aa5-ac26-0521d91c5191-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:02:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] Acquiring lock "cinder-quobyte-7bfb172d-6014-4aa5-ac26-0521d91c5191" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:02:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] Lock "cinder-quobyte-7bfb172d-6014-4aa5-ac26-0521d91c5191" acquired by "delete_volume" :: waited 0.029s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:02:44 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4743230-f503-4224-87ba-53eee5c2e659]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:02:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7bfb172d-6014-4aa5-ac26-0521d91c5191 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:02:44 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7bfb172d-6014-4aa5-ac26-0521d91c5191 Jun 25 17:02:44 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:45 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.086s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 8 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Flow 'volume_create_manager' (f7980141-5ec9-4023-8037-ec6bbe74a963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23038de-1d9a-4eae-8665-65f5108a778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23038de-1d9a-4eae-8665-65f5108a778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-623307286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc00c63-9646-4ad8-8f2d-41f601f35b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562749940d0d4f31a27973e817f53944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:02:46Z,use_quota=True,user_id='7f9fd707835942ed872e9899522ad272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28c1757-a9c6-4a5b-a612-0e7a6029c022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28c1757-a9c6-4a5b-a612-0e7a6029c022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed550b4-6792-4804-8e30-2bcf682524cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed550b4-6792-4804-8e30-2bcf682524cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fc00c63-9646-4ad8-8f2d-41f601f35b6a', 'volume_name': 'volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3090b9-b0ff-429b-a3e4-de0701e6cf1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3090b9-b0ff-429b-a3e4-de0701e6cf1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff00f440-0b59-4359-b752-d2a4759e2690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:45 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Volume 3fc00c63-9646-4ad8-8f2d-41f601f35b6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a', 'volume_size': 1} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-623307286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc00c63-9646-4ad8-8f2d-41f601f35b6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='562749940d0d4f31a27973e817f53944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:02:46Z,use_quota=True,user_id='7f9fd707835942ed872e9899522ad272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Creating volume 3fc00c63-9646-4ad8-8f2d-41f601f35b6a {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:02:45 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:02:45 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a 1073741824 Jun 25 17:02:45 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:45 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7bfb172d-6014-4aa5-ac26-0521d91c5191" returned: 0 in 1.245s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:02:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7bfb172d-6014-4aa5-ac26-0521d91c5191 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:02:45 devstack sudo[95846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7bfb172d-6014-4aa5-ac26-0521d91c5191 Jun 25 17:02:45 devstack sudo[95846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:46 devstack sudo[95846]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7bfb172d-6014-4aa5-ac26-0521d91c5191" returned: 0 in 0.918s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:02:46 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] Lock "cinder-quobyte-7bfb172d-6014-4aa5-ac26-0521d91c5191" released by "delete_volume" :: held 2.231s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:02:46 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] Created reservations ['8a237bb2-2878-454e-8aec-0865d350ae92', 'f9fdce8e-dbeb-48b8-ab2b-96a6fe47de0b', '8b0deb41-a415-431d-9f0d-3d350383edd5', 'd4e2f489-2578-46fe-9615-cc388cef3fce'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:02:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:02:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:02:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:02:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:02:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:02:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:02:47 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:02:47 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:47 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a 1073741824" returned: 0 in 1.394s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:02:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:02:47 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a Jun 25 17:02:47 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:47 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.845s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:02:47 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:02:47 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] Acquiring lock "cinder-843648a6-e921-4fc2-aa8b-8b7da51347cd-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:02:48 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] Deleted volume successfully. Jun 25 17:02:48 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] Lock "cinder-843648a6-e921-4fc2-aa8b-8b7da51347cd-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:02:48 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-0eb9fea5-7fc7-4154-b158-d74da81e582c tempest-ServersNegativeTestJSON-1151297991 None] Lock "cinder-7bfb172d-6014-4aa5-ac26-0521d91c5191-delete_volume" released by "delete_volume" :: held 3.526s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:02:48 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] Acquiring lock "cinder-quobyte-843648a6-e921-4fc2-aa8b-8b7da51347cd" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:02:48 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] Lock "cinder-quobyte-843648a6-e921-4fc2-aa8b-8b7da51347cd" acquired by "delete_volume" :: waited 0.020s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:02:48 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c882a2e-60ce-4235-aa75-4149bce16748]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:02:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-843648a6-e921-4fc2-aa8b-8b7da51347cd {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:02:48 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-843648a6-e921-4fc2-aa8b-8b7da51347cd Jun 25 17:02:48 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:48 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a" returned: 0 in 1.289s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:02:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] <== create_volume: return (2786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:02:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.795s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:02:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff00f440-0b59-4359-b752-d2a4759e2690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272967f5-d0a7-4fab-b557-15d63153be7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:02:48 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Volume volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a (3fc00c63-9646-4ad8-8f2d-41f601f35b6a): created successfully Jun 25 17:02:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272967f5-d0a7-4fab-b557-15d63153be7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:02:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Flow 'volume_create_manager' (f7980141-5ec9-4023-8037-ec6bbe74a963) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:02:48 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-78732e05-9fe2-4085-819a-0a95fcf1d1b4 tempest-ServerActionsTestOtherA-442960509 None] Created volume successfully. Jun 25 17:02:49 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-843648a6-e921-4fc2-aa8b-8b7da51347cd" returned: 0 in 1.308s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:02:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-843648a6-e921-4fc2-aa8b-8b7da51347cd {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:02:49 devstack sudo[95865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-843648a6-e921-4fc2-aa8b-8b7da51347cd Jun 25 17:02:49 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:50 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-843648a6-e921-4fc2-aa8b-8b7da51347cd" returned: 0 in 0.995s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:02:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] Lock "cinder-quobyte-843648a6-e921-4fc2-aa8b-8b7da51347cd" released by "delete_volume" :: held 2.376s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:02:50 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] Created reservations ['dbe0cd25-af6b-4ffd-963e-fce5a9007fc8', '570729ba-ab1a-4fe5-aa50-923c0231f5a1', 'ee1ffbb8-25ca-46da-b123-7e6d54df2130', '5f803fe0-2dac-4265-93f6-1b1f8c607f1d'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:02:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:02:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:02:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:02:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:02:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:02:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:02:50 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:02:50 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:02:51 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Jun 25 17:02:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.126s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:02:51 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:02:51 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] Deleted volume successfully. Jun 25 17:02:51 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-82e5b117-4eff-4c09-b89c-bf330ff6bc1a tempest-ServersNegativeTestJSON-1151297991 None] Lock "cinder-843648a6-e921-4fc2-aa8b-8b7da51347cd-delete_volume" released by "delete_volume" :: held 3.896s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:03:00 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=22,cinder:UPDATE=37,cinder:INSERT=10,cinder:DELETE=2 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:03:01 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=23,cinder:INSERT=5,cinder:UPDATE=30,cinder:DELETE=4 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:03:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:03:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:03:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:03:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:03:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:03:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:03:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:03:44 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:03:44 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Flow 'volume_create_manager' (0e1c70f2-8a65-460a-805f-35e5177ee12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c749d9-b3ed-43e3-8973-811359356c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c749d9-b3ed-43e3-8973-811359356c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-311545847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3aa368b-fe76-4158-89cf-b5a3ce0c473d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9e6851ba97423a9f6a915e0217ec66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:03:45Z,use_quota=True,user_id='39c78244686c49caa8c658f86d01fb22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b248a36e-5387-4d5c-a678-607937ea8105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b248a36e-5387-4d5c-a678-607937ea8105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f0294b-4afb-4290-b387-5cec9e181102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f0294b-4afb-4290-b387-5cec9e181102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3aa368b-fe76-4158-89cf-b5a3ce0c473d', 'volume_name': 'volume-c3aa368b-fe76-4158-89cf-b5a3ce0c473d', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a006e9-5dc1-419e-9a9f-e133009151ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a006e9-5dc1-419e-9a9f-e133009151ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92f004a-c0d2-4a2c-abc4-c825a547af12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:03:45 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Volume c3aa368b-fe76-4158-89cf-b5a3ce0c473d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3aa368b-fe76-4158-89cf-b5a3ce0c473d', 'volume_size': 1} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-311545847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3aa368b-fe76-4158-89cf-b5a3ce0c473d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa9e6851ba97423a9f6a915e0217ec66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:03:45Z,use_quota=True,user_id='39c78244686c49caa8c658f86d01fb22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Creating volume c3aa368b-fe76-4158-89cf-b5a3ce0c473d {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:03:45 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c3aa368b-fe76-4158-89cf-b5a3ce0c473d 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:03:45 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c3aa368b-fe76-4158-89cf-b5a3ce0c473d 1073741824 Jun 25 17:03:45 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:03:45 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.515s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 8 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:03:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:03:47 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Jun 25 17:03:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c3aa368b-fe76-4158-89cf-b5a3ce0c473d 1073741824" returned: 0 in 2.629s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:03:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c3aa368b-fe76-4158-89cf-b5a3ce0c473d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:03:48 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c3aa368b-fe76-4158-89cf-b5a3ce0c473d Jun 25 17:03:48 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:03:50 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Jun 25 17:03:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c3aa368b-fe76-4158-89cf-b5a3ce0c473d" returned: 0 in 2.111s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:03:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] <== create_volume: return (4931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:03:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.936s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:03:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92f004a-c0d2-4a2c-abc4-c825a547af12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3aa368b-fe76-4158-89cf-b5a3ce0c473d', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:03:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40328a1a-aca8-4718-b5b6-e1277b137a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:03:50 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Volume volume-c3aa368b-fe76-4158-89cf-b5a3ce0c473d (c3aa368b-fe76-4158-89cf-b5a3ce0c473d): created successfully Jun 25 17:03:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40328a1a-aca8-4718-b5b6-e1277b137a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:03:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Flow 'volume_create_manager' (0e1c70f2-8a65-460a-805f-35e5177ee12f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:03:50 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b25b4370-2a97-4b23-80f3-625104769ed4 tempest-VolumesAdminNegativeTest-498901484 None] Created volume successfully. Jun 25 17:03:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] Acquiring lock "cinder-c3aa368b-fe76-4158-89cf-b5a3ce0c473d-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:03:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] Lock "cinder-c3aa368b-fe76-4158-89cf-b5a3ce0c473d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:03:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] Acquiring lock "cinder-quobyte-c3aa368b-fe76-4158-89cf-b5a3ce0c473d" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:03:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] Lock "cinder-quobyte-c3aa368b-fe76-4158-89cf-b5a3ce0c473d" acquired by "delete_volume" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:03:52 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2228e1dd-7536-423f-ae46-b23a7cb809e2]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:03:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c3aa368b-fe76-4158-89cf-b5a3ce0c473d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:03:52 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c3aa368b-fe76-4158-89cf-b5a3ce0c473d Jun 25 17:03:52 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:03:53 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Jun 25 17:03:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c3aa368b-fe76-4158-89cf-b5a3ce0c473d" returned: 0 in 1.071s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:03:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c3aa368b-fe76-4158-89cf-b5a3ce0c473d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:03:53 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c3aa368b-fe76-4158-89cf-b5a3ce0c473d Jun 25 17:03:53 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:03:54 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Jun 25 17:03:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c3aa368b-fe76-4158-89cf-b5a3ce0c473d" returned: 0 in 0.767s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:03:54 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] Lock "cinder-quobyte-c3aa368b-fe76-4158-89cf-b5a3ce0c473d" released by "delete_volume" :: held 1.907s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:03:54 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] Created reservations ['70713402-d9a6-4778-9a5b-cce61e1d72a2', '251c97c6-04a0-465c-b54e-44f902470a0c', '83f769f4-9833-4765-892f-6e27e022b3f8', 'e8dde5dc-2f99-4e03-a140-84b43c0beaeb'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:03:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:03:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:03:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:03:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:03:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:03:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:03:54 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:03:54 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:03:55 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Jun 25 17:03:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.258s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:03:55 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:03:55 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] Deleted volume successfully. Jun 25 17:03:55 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fe4d90a3-62a0-446b-a9aa-dc6a17618357 tempest-VolumesAdminNegativeTest-498901484 None] Lock "cinder-c3aa368b-fe76-4158-89cf-b5a3ce0c473d-delete_volume" released by "delete_volume" :: held 3.538s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:03:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-c627adbb-bd9e-4f4b-b11e-39cc76a9c964 req-2720a9ae-ac3e-42fa-8b94-bdd4d34c47f0 tempest-ServerActionsTestOtherA-442960509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:03:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-c627adbb-bd9e-4f4b-b11e-39cc76a9c964 req-2720a9ae-ac3e-42fa-8b94-bdd4d34c47f0 tempest-ServerActionsTestOtherA-442960509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:03:59 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[518559b0-39a9-4d99-a484-529c1e91f4cb]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:03:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-c627adbb-bd9e-4f4b-b11e-39cc76a9c964 req-2720a9ae-ac3e-42fa-8b94-bdd4d34c47f0 tempest-ServerActionsTestOtherA-442960509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:03:59 devstack sudo[96613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a Jun 25 17:03:59 devstack sudo[96613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:04:00 devstack sudo[96613]: pam_unix(sudo:session): session closed for user root Jun 25 17:04:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-c627adbb-bd9e-4f4b-b11e-39cc76a9c964 req-2720a9ae-ac3e-42fa-8b94-bdd4d34c47f0 tempest-ServerActionsTestOtherA-442960509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a" returned: 0 in 1.098s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:04:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-c627adbb-bd9e-4f4b-b11e-39cc76a9c964 req-2720a9ae-ac3e-42fa-8b94-bdd4d34c47f0 tempest-ServerActionsTestOtherA-442960509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.120s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:04:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-c627adbb-bd9e-4f4b-b11e-39cc76a9c964 req-2720a9ae-ac3e-42fa-8b94-bdd4d34c47f0 tempest-ServerActionsTestOtherA-442960509 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ba53d2c-3757-40e2-93d3-f76daab4b35d', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:04:00 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-c627adbb-bd9e-4f4b-b11e-39cc76a9c964 req-2720a9ae-ac3e-42fa-8b94-bdd4d34c47f0 tempest-ServerActionsTestOtherA-442960509 None] attachment_update completed successfully. Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Flow 'volume_create_manager' (161327c6-733e-432a-9137-300a4646264c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86aee36-3105-4f12-b7c1-a6f0908f8d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86aee36-3105-4f12-b7c1-a6f0908f8d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-531369802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ae09c5-2eeb-4a26-a616-abc98053385f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4002dfc22634fedb045eaa844d23c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:04:06Z,use_quota=True,user_id='6562774526364706b036a3b3405e26f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b03381ae-775e-4c46-965d-01a7a79b9244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b03381ae-775e-4c46-965d-01a7a79b9244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234527d3-161c-4293-bfe8-dc0b57729b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234527d3-161c-4293-bfe8-dc0b57729b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4ae09c5-2eeb-4a26-a616-abc98053385f', 'volume_name': 'volume-a4ae09c5-2eeb-4a26-a616-abc98053385f', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a8d67c4-5bfd-4833-b0b8-121c43b8ab95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a8d67c4-5bfd-4833-b0b8-121c43b8ab95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2ea536-5c2b-490b-8fa4-8d49856996db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:04:06 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Volume a4ae09c5-2eeb-4a26-a616-abc98053385f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4ae09c5-2eeb-4a26-a616-abc98053385f', 'volume_size': 1} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-531369802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ae09c5-2eeb-4a26-a616-abc98053385f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4002dfc22634fedb045eaa844d23c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:04:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:04:06Z,use_quota=True,user_id='6562774526364706b036a3b3405e26f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Creating volume a4ae09c5-2eeb-4a26-a616-abc98053385f {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:04:06 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:04:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a4ae09c5-2eeb-4a26-a616-abc98053385f 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:04:06 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a4ae09c5-2eeb-4a26-a616-abc98053385f 1073741824 Jun 25 17:04:06 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:04:07 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Jun 25 17:04:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a4ae09c5-2eeb-4a26-a616-abc98053385f 1073741824" returned: 0 in 1.402s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:04:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a4ae09c5-2eeb-4a26-a616-abc98053385f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:04:08 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a4ae09c5-2eeb-4a26-a616-abc98053385f Jun 25 17:04:08 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:04:08 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Jun 25 17:04:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a4ae09c5-2eeb-4a26-a616-abc98053385f" returned: 0 in 0.806s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:04:08 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] <== create_volume: return (2288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:04:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.291s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:04:08 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2ea536-5c2b-490b-8fa4-8d49856996db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4ae09c5-2eeb-4a26-a616-abc98053385f', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:04:08 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd5a673-88a3-4e9e-9421-b9bab7f8fb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:04:08 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Volume volume-a4ae09c5-2eeb-4a26-a616-abc98053385f (a4ae09c5-2eeb-4a26-a616-abc98053385f): created successfully Jun 25 17:04:08 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd5a673-88a3-4e9e-9421-b9bab7f8fb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:04:08 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Flow 'volume_create_manager' (161327c6-733e-432a-9137-300a4646264c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:04:08 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-6aed1b9a-0162-4a69-86ec-38e09e6ac2a6 tempest-AttachVolumeShelveTestJSON-18181129 None] Created volume successfully. Jun 25 17:04:10 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-89329914-e83f-4f21-bc46-343e84ac4be0 req-68dfc9dc-16f8-41a8-900d-348acdce0ca5 tempest-ServerActionsTestOtherA-442960509 None] Terminate volume connection completed successfully. Jun 25 17:04:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-89329914-e83f-4f21-bc46-343e84ac4be0 req-68dfc9dc-16f8-41a8-900d-348acdce0ca5 tempest-ServerActionsTestOtherA-442960509 None] Deleting attachment 7ba53d2c-3757-40e2-93d3-f76daab4b35d. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:04:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-89329914-e83f-4f21-bc46-343e84ac4be0 req-20e93206-1793-43f6-ba7b-43d8261a123d tempest-ServerActionsTestOtherA-442960509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:04:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-89329914-e83f-4f21-bc46-343e84ac4be0 req-20e93206-1793-43f6-ba7b-43d8261a123d tempest-ServerActionsTestOtherA-442960509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:04:13 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[96562165-7831-4580-bfaf-c415fe28e5e3]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:04:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-89329914-e83f-4f21-bc46-343e84ac4be0 req-20e93206-1793-43f6-ba7b-43d8261a123d tempest-ServerActionsTestOtherA-442960509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:04:13 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a Jun 25 17:04:13 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:04:14 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Jun 25 17:04:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-89329914-e83f-4f21-bc46-343e84ac4be0 req-20e93206-1793-43f6-ba7b-43d8261a123d tempest-ServerActionsTestOtherA-442960509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a" returned: 0 in 1.158s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:04:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-89329914-e83f-4f21-bc46-343e84ac4be0 req-20e93206-1793-43f6-ba7b-43d8261a123d tempest-ServerActionsTestOtherA-442960509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.179s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:04:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-89329914-e83f-4f21-bc46-343e84ac4be0 req-20e93206-1793-43f6-ba7b-43d8261a123d tempest-ServerActionsTestOtherA-442960509 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67809b9e-c8fd-4b90-bda5-674857b9cdea', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:04:14 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-89329914-e83f-4f21-bc46-343e84ac4be0 req-20e93206-1793-43f6-ba7b-43d8261a123d tempest-ServerActionsTestOtherA-442960509 None] attachment_update completed successfully. Jun 25 17:04:24 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=12,cinder:SELECT=23,cinder:INSERT=4,cinder:DELETE=2 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:04:24 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=19,cinder:UPDATE=22,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Flow 'volume_create_manager' (4fd41b0d-4fd9-4e2d-b85e-87c012c90b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986a18b8-8b92-4ff8-81f9-bfd8753ee695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986a18b8-8b92-4ff8-81f9-bfd8753ee695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1996171424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e5807a-0fab-48c7-80b0-31952d07ae48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0dc1e4c4f5b4222a58b1e37ba3133bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:04:26Z,use_quota=True,user_id='041894bc90034266943e391cc4421b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bdce9d-95ce-4125-aef6-d2fec84bd4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bdce9d-95ce-4125-aef6-d2fec84bd4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092ebe5c-c41b-4dba-9f7d-dbf149ca824e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092ebe5c-c41b-4dba-9f7d-dbf149ca824e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5e5807a-0fab-48c7-80b0-31952d07ae48', 'volume_name': 'volume-d5e5807a-0fab-48c7-80b0-31952d07ae48', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba49a851-46d6-466d-bb37-976d5dee5e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba49a851-46d6-466d-bb37-976d5dee5e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6f4083-e498-49c3-bea0-55f4e860a592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:04:25 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Volume d5e5807a-0fab-48c7-80b0-31952d07ae48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5e5807a-0fab-48c7-80b0-31952d07ae48', 'volume_size': 1} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1996171424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e5807a-0fab-48c7-80b0-31952d07ae48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0dc1e4c4f5b4222a58b1e37ba3133bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:04:26Z,use_quota=True,user_id='041894bc90034266943e391cc4421b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Creating volume d5e5807a-0fab-48c7-80b0-31952d07ae48 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:04:25 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:04:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d5e5807a-0fab-48c7-80b0-31952d07ae48 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:04:25 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d5e5807a-0fab-48c7-80b0-31952d07ae48 1073741824 Jun 25 17:04:25 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:04:27 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Jun 25 17:04:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d5e5807a-0fab-48c7-80b0-31952d07ae48 1073741824" returned: 0 in 1.272s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:04:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d5e5807a-0fab-48c7-80b0-31952d07ae48 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:04:27 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d5e5807a-0fab-48c7-80b0-31952d07ae48 Jun 25 17:04:27 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:04:27 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Jun 25 17:04:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d5e5807a-0fab-48c7-80b0-31952d07ae48" returned: 0 in 0.759s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:04:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] <== create_volume: return (2098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:04:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:04:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd6f4083-e498-49c3-bea0-55f4e860a592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5e5807a-0fab-48c7-80b0-31952d07ae48', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:04:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917744c3-7e55-4b59-bc34-51cbcc22012f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:04:27 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Volume volume-d5e5807a-0fab-48c7-80b0-31952d07ae48 (d5e5807a-0fab-48c7-80b0-31952d07ae48): created successfully Jun 25 17:04:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (917744c3-7e55-4b59-bc34-51cbcc22012f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:04:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Flow 'volume_create_manager' (4fd41b0d-4fd9-4e2d-b85e-87c012c90b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:04:28 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-ab8778cd-2deb-4496-a0c7-f1c9210c4b17 tempest-AttachVolumeTestJSON-641953485 None] Created volume successfully. Jun 25 17:04:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-a8240571-2e5a-40dc-8910-2fde4dfa973a req-a803b3d5-2120-4087-82c2-0a5df3d5436d tempest-AttachVolumeShelveTestJSON-18181129 None] No connector for attachment 274e3b9b-e4f3-47ac-9bcb-df9f880ff2fc; skipping storage backend terminate_connection call. {{(pid=93869) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 25 17:04:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-a8240571-2e5a-40dc-8910-2fde4dfa973a req-a803b3d5-2120-4087-82c2-0a5df3d5436d tempest-AttachVolumeShelveTestJSON-18181129 None] Deleting attachment 274e3b9b-e4f3-47ac-9bcb-df9f880ff2fc. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:04:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-ca7bb9fa-d79f-4d0d-a3ed-3424e1a4dad2 req-e7b1cfcc-43f8-400d-957b-96705a3bc356 tempest-AttachVolumeTestJSON-641953485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:04:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-ca7bb9fa-d79f-4d0d-a3ed-3424e1a4dad2 req-e7b1cfcc-43f8-400d-957b-96705a3bc356 tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:04:32 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3ae18f-38d7-47df-b916-5332ef98f9b6]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:04:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-ca7bb9fa-d79f-4d0d-a3ed-3424e1a4dad2 req-e7b1cfcc-43f8-400d-957b-96705a3bc356 tempest-AttachVolumeTestJSON-641953485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d5e5807a-0fab-48c7-80b0-31952d07ae48 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:04:32 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d5e5807a-0fab-48c7-80b0-31952d07ae48 Jun 25 17:04:32 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:04:33 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Jun 25 17:04:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-ca7bb9fa-d79f-4d0d-a3ed-3424e1a4dad2 req-e7b1cfcc-43f8-400d-957b-96705a3bc356 tempest-AttachVolumeTestJSON-641953485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d5e5807a-0fab-48c7-80b0-31952d07ae48" returned: 0 in 1.213s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:04:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-ca7bb9fa-d79f-4d0d-a3ed-3424e1a4dad2 req-e7b1cfcc-43f8-400d-957b-96705a3bc356 tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.242s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:04:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-ca7bb9fa-d79f-4d0d-a3ed-3424e1a4dad2 req-e7b1cfcc-43f8-400d-957b-96705a3bc356 tempest-AttachVolumeTestJSON-641953485 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-d5e5807a-0fab-48c7-80b0-31952d07ae48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '796fa176-c7f8-4973-88be-ac5a77f4d5e1', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:04:33 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-ca7bb9fa-d79f-4d0d-a3ed-3424e1a4dad2 req-e7b1cfcc-43f8-400d-957b-96705a3bc356 tempest-AttachVolumeTestJSON-641953485 None] attachment_update completed successfully. Jun 25 17:04:43 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7,cinder:INSERT=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:04:43 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:04:51 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-e2cedde0-11fe-4073-a10d-6c1f7745bcbf req-46467060-ea4a-4af8-931b-d4897af5596c tempest-ServerActionsTestOtherA-442960509 None] Terminate volume connection completed successfully. Jun 25 17:04:51 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-e2cedde0-11fe-4073-a10d-6c1f7745bcbf req-46467060-ea4a-4af8-931b-d4897af5596c tempest-ServerActionsTestOtherA-442960509 None] Deleting attachment 67809b9e-c8fd-4b90-bda5-674857b9cdea. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:05:01 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:05:01 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=2 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:05:01 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:05:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Flow 'volume_create_manager' (141f865f-3745-4560-ad16-da01105e0a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:05:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145e8cdd-7c81-4a7b-a36b-ddd97673ddca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:05:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145e8cdd-7c81-4a7b-a36b-ddd97673ddca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-676262139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae86197-cb5c-4020-ab0a-5812749c9346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f88c865754f4607af60198e58319602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:05:02Z,use_quota=True,user_id='20775efec8d2456b9458e8842e2d119d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:05:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3b8176-401d-43d1-9898-ddf338e43714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:05:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb3b8176-401d-43d1-9898-ddf338e43714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:05:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c69f0bb-84fd-4592-8591-881189892fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:05:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c69f0bb-84fd-4592-8591-881189892fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ae86197-cb5c-4020-ab0a-5812749c9346', 'volume_name': 'volume-2ae86197-cb5c-4020-ab0a-5812749c9346', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:05:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1474920d-3964-47e9-8ab3-d6ad28a8df3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:05:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1474920d-3964-47e9-8ab3-d6ad28a8df3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:05:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059d0f64-9fa2-4a24-acbc-d91e4373d42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:05:02 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Volume 2ae86197-cb5c-4020-ab0a-5812749c9346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ae86197-cb5c-4020-ab0a-5812749c9346', 'volume_size': 1} Jun 25 17:05:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:05:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:05:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-676262139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae86197-cb5c-4020-ab0a-5812749c9346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f88c865754f4607af60198e58319602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:05:02Z,use_quota=True,user_id='20775efec8d2456b9458e8842e2d119d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:05:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Creating volume 2ae86197-cb5c-4020-ab0a-5812749c9346 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:05:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:05:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:05:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:05:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:05:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:05:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:05:02 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:05:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ae86197-cb5c-4020-ab0a-5812749c9346 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:02 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ae86197-cb5c-4020-ab0a-5812749c9346 1073741824 Jun 25 17:05:02 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] Acquiring lock "cinder-3fc00c63-9646-4ad8-8f2d-41f601f35b6a-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:05:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] Lock "cinder-3fc00c63-9646-4ad8-8f2d-41f601f35b6a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:05:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] Acquiring lock "cinder-quobyte-3fc00c63-9646-4ad8-8f2d-41f601f35b6a" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:05:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] Lock "cinder-quobyte-3fc00c63-9646-4ad8-8f2d-41f601f35b6a" acquired by "delete_volume" :: waited 0.020s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:05:03 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ae86197-cb5c-4020-ab0a-5812749c9346 1073741824" returned: 0 in 1.423s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:03 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e64a7ac-0adb-4323-aeca-5c7aa5270df0]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:05:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ae86197-cb5c-4020-ab0a-5812749c9346 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:03 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ae86197-cb5c-4020-ab0a-5812749c9346 Jun 25 17:05:03 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:03 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a Jun 25 17:05:03 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:04 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ae86197-cb5c-4020-ab0a-5812749c9346" returned: 0 in 0.802s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] <== create_volume: return (2295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:05:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.298s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:05:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (059d0f64-9fa2-4a24-acbc-d91e4373d42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae86197-cb5c-4020-ab0a-5812749c9346', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:05:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52df7107-2bf9-40f5-b8ce-3be621a587bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:05:04 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Volume volume-2ae86197-cb5c-4020-ab0a-5812749c9346 (2ae86197-cb5c-4020-ab0a-5812749c9346): created successfully Jun 25 17:05:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52df7107-2bf9-40f5-b8ce-3be621a587bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:05:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Flow 'volume_create_manager' (141f865f-3745-4560-ad16-da01105e0a63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:05:04 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a" returned: 0 in 0.913s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:04 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-0272148a-b028-4875-a139-83e4774b2937 tempest-TaggedAttachmentsTest-742391550 None] Created volume successfully. Jun 25 17:05:04 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a Jun 25 17:05:04 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:05 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3fc00c63-9646-4ad8-8f2d-41f601f35b6a" returned: 0 in 0.871s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] Lock "cinder-quobyte-3fc00c63-9646-4ad8-8f2d-41f601f35b6a" released by "delete_volume" :: held 1.844s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:05:05 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] Created reservations ['d5cc3ab0-50ca-4cda-b4e4-62bc89a542fa', '50820db3-0afc-49d7-b39e-059123866785', 'd73070a6-96bf-4087-b2af-dbd8ce589a82', 'c354f9ee-388b-4d8f-a9cd-204ea12744b0'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:05:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:05:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:05:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:05:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:05:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:05:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:05 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:05:05 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:06 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.980s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:06 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:05:06 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] Deleted volume successfully. Jun 25 17:05:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e2a18588-e78a-4f68-8587-1f7e99b0655b tempest-ServerActionsTestOtherA-442960509 None] Lock "cinder-3fc00c63-9646-4ad8-8f2d-41f601f35b6a-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:05:15 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=13,cinder:SELECT=6,cinder:DELETE=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:05:16 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:INSERT=5,cinder:DELETE=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:05:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] Acquiring lock "cinder-a4ae09c5-2eeb-4a26-a616-abc98053385f-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:05:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] Lock "cinder-a4ae09c5-2eeb-4a26-a616-abc98053385f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:05:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] Acquiring lock "cinder-quobyte-a4ae09c5-2eeb-4a26-a616-abc98053385f" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:05:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] Lock "cinder-quobyte-a4ae09c5-2eeb-4a26-a616-abc98053385f" acquired by "delete_volume" :: waited 0.047s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:05:26 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb09a8be-87fe-441b-9cbd-fa30f7eabfd9]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:05:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a4ae09c5-2eeb-4a26-a616-abc98053385f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:27 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a4ae09c5-2eeb-4a26-a616-abc98053385f Jun 25 17:05:27 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:27 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a4ae09c5-2eeb-4a26-a616-abc98053385f" returned: 0 in 1.096s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a4ae09c5-2eeb-4a26-a616-abc98053385f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:27 devstack sudo[98408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a4ae09c5-2eeb-4a26-a616-abc98053385f Jun 25 17:05:27 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:29 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a4ae09c5-2eeb-4a26-a616-abc98053385f" returned: 0 in 1.259s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:29 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] Lock "cinder-quobyte-a4ae09c5-2eeb-4a26-a616-abc98053385f" released by "delete_volume" :: held 2.450s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:05:29 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] Created reservations ['c8509f3e-970a-44a9-ad57-f3dbb15ebd5b', 'ed605850-d562-4792-9c37-59e4cb85246b', 'df8978ce-bed9-439b-8551-d2f7f07f6196', '6867436f-017d-4afa-a22d-1174dc764244'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:05:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:05:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:05:29 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:05:29 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:05:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:05:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:29 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:05:29 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:30 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.936s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:30 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:05:30 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] Deleted volume successfully. Jun 25 17:05:30 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d078cc34-194c-4003-8941-6504df928681 tempest-AttachVolumeShelveTestJSON-18181129 None] Lock "cinder-a4ae09c5-2eeb-4a26-a616-abc98053385f-delete_volume" released by "delete_volume" :: held 3.813s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:05:39 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=3,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:05:40 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Flow 'volume_create_manager' (a9ee54b2-3064-4e29-98a2-340d51afb9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4948f004-21ff-4cf8-9ed2-2a4958747d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4948f004-21ff-4cf8-9ed2-2a4958747d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1794387305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53623f52-46e0-4e26-87b1-2685aacaccf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='803e54771ee143d3b92cb1b6125432fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:05:42Z,use_quota=True,user_id='53ba9fccb33e485e8542122b6b241e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091c8af0-e000-4ad0-a950-3776560b42ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (091c8af0-e000-4ad0-a950-3776560b42ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be0d6e7-3e15-4a1c-ba3c-35f0dd833d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be0d6e7-3e15-4a1c-ba3c-35f0dd833d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53623f52-46e0-4e26-87b1-2685aacaccf5', 'volume_name': 'volume-53623f52-46e0-4e26-87b1-2685aacaccf5', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a804bbb1-b3b1-4afa-9d51-f3545a01c59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a804bbb1-b3b1-4afa-9d51-f3545a01c59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55a6e0a-f347-46da-bd4a-ebd4e32482c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:05:42 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Volume 53623f52-46e0-4e26-87b1-2685aacaccf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53623f52-46e0-4e26-87b1-2685aacaccf5', 'volume_size': 1} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1794387305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53623f52-46e0-4e26-87b1-2685aacaccf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='803e54771ee143d3b92cb1b6125432fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:05:42Z,use_quota=True,user_id='53ba9fccb33e485e8542122b6b241e80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Creating volume 53623f52-46e0-4e26-87b1-2685aacaccf5 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:05:42 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:05:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:42 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5 1073741824 Jun 25 17:05:42 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:43 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5 1073741824" returned: 0 in 0.951s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:43 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5 Jun 25 17:05:43 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:43 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5" returned: 0 in 0.772s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:05:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:05:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a55a6e0a-f347-46da-bd4a-ebd4e32482c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53623f52-46e0-4e26-87b1-2685aacaccf5', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:05:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e90ef94-8f82-4a1d-a5b0-4e9981e28b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:05:43 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Volume volume-53623f52-46e0-4e26-87b1-2685aacaccf5 (53623f52-46e0-4e26-87b1-2685aacaccf5): created successfully Jun 25 17:05:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e90ef94-8f82-4a1d-a5b0-4e9981e28b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:05:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Flow 'volume_create_manager' (a9ee54b2-3064-4e29-98a2-340d51afb9ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:05:44 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-5e74576d-7956-419b-baec-ccdf8de9532f req-c11fb53a-3cb2-433a-9d03-8a6faf15edde tempest-VolumesSnapshotsTestJSON-1152075717 None] Created volume successfully. Jun 25 17:05:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:05:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:05:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:05:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:05:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:05:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:05:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:44 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:05:44 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-c4447f70-b390-4b9b-9fdd-2c0ebe0dd4e0 req-abadfed1-7848-4cd9-b1d0-cf32773799d5 tempest-VolumesSnapshotsTestJSON-1152075717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:05:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-c4447f70-b390-4b9b-9fdd-2c0ebe0dd4e0 req-abadfed1-7848-4cd9-b1d0-cf32773799d5 tempest-VolumesSnapshotsTestJSON-1152075717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:05:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [req-c4447f70-b390-4b9b-9fdd-2c0ebe0dd4e0 req-abadfed1-7848-4cd9-b1d0-cf32773799d5 tempest-VolumesSnapshotsTestJSON-1152075717 None] Creating offline snapshot c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5 of volume 53623f52-46e0-4e26-87b1-2685aacaccf5 {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:05:44 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22fc0a2-3b70-4dda-b193-e27b5ef90aa6]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:05:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-c4447f70-b390-4b9b-9fdd-2c0ebe0dd4e0 req-abadfed1-7848-4cd9-b1d0-cf32773799d5 tempest-VolumesSnapshotsTestJSON-1152075717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:44 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5 Jun 25 17:05:44 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:45 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.063s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:05:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:05:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 8 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:05:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:05:46 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-c4447f70-b390-4b9b-9fdd-2c0ebe0dd4e0 req-abadfed1-7848-4cd9-b1d0-cf32773799d5 tempest-VolumesSnapshotsTestJSON-1152075717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5" returned: 0 in 1.482s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-c4447f70-b390-4b9b-9fdd-2c0ebe0dd4e0 req-abadfed1-7848-4cd9-b1d0-cf32773799d5 tempest-VolumesSnapshotsTestJSON-1152075717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:46 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5 1G Jun 25 17:05:46 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:47 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-c4447f70-b390-4b9b-9fdd-2c0ebe0dd4e0 req-abadfed1-7848-4cd9-b1d0-cf32773799d5 tempest-VolumesSnapshotsTestJSON-1152075717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5 1G" returned: 0 in 1.290s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-c4447f70-b390-4b9b-9fdd-2c0ebe0dd4e0 req-abadfed1-7848-4cd9-b1d0-cf32773799d5 tempest-VolumesSnapshotsTestJSON-1152075717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53623f52-46e0-4e26-87b1-2685aacaccf5 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:47 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53623f52-46e0-4e26-87b1-2685aacaccf5 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5 Jun 25 17:05:47 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:48 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-c4447f70-b390-4b9b-9fdd-2c0ebe0dd4e0 req-abadfed1-7848-4cd9-b1d0-cf32773799d5 tempest-VolumesSnapshotsTestJSON-1152075717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-53623f52-46e0-4e26-87b1-2685aacaccf5 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5" returned: 0 in 1.036s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:48 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [req-c4447f70-b390-4b9b-9fdd-2c0ebe0dd4e0 req-abadfed1-7848-4cd9-b1d0-cf32773799d5 tempest-VolumesSnapshotsTestJSON-1152075717 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5 is being set with open permissions: ugo+rw Jun 25 17:05:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-c4447f70-b390-4b9b-9fdd-2c0ebe0dd4e0 req-abadfed1-7848-4cd9-b1d0-cf32773799d5 tempest-VolumesSnapshotsTestJSON-1152075717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:48 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5 Jun 25 17:05:48 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:49 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-c4447f70-b390-4b9b-9fdd-2c0ebe0dd4e0 req-abadfed1-7848-4cd9-b1d0-cf32773799d5 tempest-VolumesSnapshotsTestJSON-1152075717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5" returned: 0 in 0.712s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-c4447f70-b390-4b9b-9fdd-2c0ebe0dd4e0 req-abadfed1-7848-4cd9-b1d0-cf32773799d5 tempest-VolumesSnapshotsTestJSON-1152075717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:49 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.info Jun 25 17:05:49 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:50 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-c4447f70-b390-4b9b-9fdd-2c0ebe0dd4e0 req-abadfed1-7848-4cd9-b1d0-cf32773799d5 tempest-VolumesSnapshotsTestJSON-1152075717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.info" returned: 0 in 0.721s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:50 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [req-c4447f70-b390-4b9b-9fdd-2c0ebe0dd4e0 req-abadfed1-7848-4cd9-b1d0-cf32773799d5 tempest-VolumesSnapshotsTestJSON-1152075717 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.info is being set with open permissions: ugo+rw Jun 25 17:05:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-c4447f70-b390-4b9b-9fdd-2c0ebe0dd4e0 req-abadfed1-7848-4cd9-b1d0-cf32773799d5 tempest-VolumesSnapshotsTestJSON-1152075717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:50 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.info Jun 25 17:05:50 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:50 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-c4447f70-b390-4b9b-9fdd-2c0ebe0dd4e0 req-abadfed1-7848-4cd9-b1d0-cf32773799d5 tempest-VolumesSnapshotsTestJSON-1152075717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.info" returned: 0 in 0.629s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-c4447f70-b390-4b9b-9fdd-2c0ebe0dd4e0 req-abadfed1-7848-4cd9-b1d0-cf32773799d5 tempest-VolumesSnapshotsTestJSON-1152075717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.014s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:05:50 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-c4447f70-b390-4b9b-9fdd-2c0ebe0dd4e0 req-abadfed1-7848-4cd9-b1d0-cf32773799d5 tempest-VolumesSnapshotsTestJSON-1152075717 None] Create snapshot completed successfully Jun 25 17:05:51 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] Acquiring lock "cinder-c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:05:51 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] Lock "cinder-c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:05:51 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] Acquiring lock "cinder-quobyte-53623f52-46e0-4e26-87b1-2685aacaccf5" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:05:51 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] Lock "cinder-quobyte-53623f52-46e0-4e26-87b1-2685aacaccf5" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:05:51 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] Acquiring lock "cinder-quobyte-c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:05:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] Lock "cinder-quobyte-c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:05:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] Deleting offline snapshot c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5 of volume 53623f52-46e0-4e26-87b1-2685aacaccf5 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:05:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] snapshot_file for this snap is: volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:05:52 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9761cfc-4014-4ae7-910a-ba30ccbcec47]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:05:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:52 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5 Jun 25 17:05:52 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:53 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5" returned: 0 in 1.168s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:53 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-53623f52-46e0-4e26-87b1-2685aacaccf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:05:53 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a20c0f2-9b22-4cd0-bed9-4d8d09b6f9c9]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:05:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:53 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5 Jun 25 17:05:53 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:55 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5" returned: 0 in 1.616s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:55 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5 Jun 25 17:05:55 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:56 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5" returned: 0 in 1.719s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:56 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5 Jun 25 17:05:56 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:58 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5.c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5" returned: 0 in 1.364s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] Lock "cinder-quobyte-c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5" released by "_delete_snapshot" :: held 6.141s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:05:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] Lock "cinder-quobyte-53623f52-46e0-4e26-87b1-2685aacaccf5" released by "delete_snapshot" :: held 6.213s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:05:58 devstack cinder-volume[93869]: WARNING cinder.quota [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:05:58 devstack cinder-volume[93869]: DEBUG cinder.quota [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] Created reservations ['6d4ea00f-8ebf-4afe-a043-380cd0e93bac', '2ba8442a-3228-4db9-aae0-7baedfb46300', '86224ba3-98d5-4600-a7fd-9cdfb0ff449c', '8fdd1cb7-6c1e-4518-bc4d-b90c4eec5bc6'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:05:58 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] Delete snapshot completed successfully. Jun 25 17:05:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-ca1e22e1-b2d0-4ec1-9ea3-051ec4e29c8d req-9b14fd21-464a-446b-a582-bc04be519af6 tempest-VolumesSnapshotsTestJSON-1152075717 None] Lock "cinder-c8d5c5a4-09c6-41fe-b074-cf51acd2f8e5-delete_snapshot" released by "delete_snapshot" :: held 6.451s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:05:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] Acquiring lock "cinder-53623f52-46e0-4e26-87b1-2685aacaccf5-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:05:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] Lock "cinder-53623f52-46e0-4e26-87b1-2685aacaccf5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:05:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] Acquiring lock "cinder-quobyte-53623f52-46e0-4e26-87b1-2685aacaccf5" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:05:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] Lock "cinder-quobyte-53623f52-46e0-4e26-87b1-2685aacaccf5" acquired by "delete_volume" :: waited 0.029s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:05:58 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[320f0606-2841-46ab-b0d4-63e7be51e9f0]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:05:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:58 devstack sudo[98736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5 Jun 25 17:05:58 devstack sudo[98736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:05:59 devstack sudo[98736]: pam_unix(sudo:session): session closed for user root Jun 25 17:05:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5" returned: 0 in 1.050s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:05:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:05:59 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5 Jun 25 17:05:59 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:01 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-53623f52-46e0-4e26-87b1-2685aacaccf5" returned: 0 in 1.435s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] Lock "cinder-quobyte-53623f52-46e0-4e26-87b1-2685aacaccf5" released by "delete_volume" :: held 2.582s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:06:01 devstack cinder-volume[93869]: DEBUG cinder.quota [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] Created reservations ['b013d150-aeb0-4b9e-90b7-349cc5586129', '07ce7334-fdf7-4a67-a972-5a27c43d062b', '7d1010c9-d2ee-434d-b6f0-d6a7b47b0f14', '759a249e-f4f8-4e04-b33b-8dabfdf92025'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:06:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:06:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.032s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:06:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:06:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:06:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.064s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:06:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:02 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:06:02 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:04 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 2.465s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:04 devstack cinder-volume[93869]: DEBUG cinder.manager [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:06:04 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] Deleted volume successfully. Jun 25 17:06:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-efb080b2-776a-4210-b560-1a17f7d7910b req-5ad21d5b-1375-4c1a-bd52-80f1d16b33d4 tempest-VolumesSnapshotsTestJSON-1152075717 None] Lock "cinder-53623f52-46e0-4e26-87b1-2685aacaccf5-delete_volume" released by "delete_volume" :: held 5.809s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:06:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-f25a8843-4ec8-4613-a94d-c2dcc27256ea req-5d1f849e-8f9d-4ccb-997b-c026e1df8bbf tempest-TaggedAttachmentsTest-742391550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:06:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-f25a8843-4ec8-4613-a94d-c2dcc27256ea req-5d1f849e-8f9d-4ccb-997b-c026e1df8bbf tempest-TaggedAttachmentsTest-742391550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:06:09 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60ea1b8-76d5-4fe8-ba05-21bb343c27a2]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:06:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-f25a8843-4ec8-4613-a94d-c2dcc27256ea req-5d1f849e-8f9d-4ccb-997b-c026e1df8bbf tempest-TaggedAttachmentsTest-742391550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ae86197-cb5c-4020-ab0a-5812749c9346 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:09 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ae86197-cb5c-4020-ab0a-5812749c9346 Jun 25 17:06:09 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:10 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-f25a8843-4ec8-4613-a94d-c2dcc27256ea req-5d1f849e-8f9d-4ccb-997b-c026e1df8bbf tempest-TaggedAttachmentsTest-742391550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ae86197-cb5c-4020-ab0a-5812749c9346" returned: 0 in 0.809s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-f25a8843-4ec8-4613-a94d-c2dcc27256ea req-5d1f849e-8f9d-4ccb-997b-c026e1df8bbf tempest-TaggedAttachmentsTest-742391550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.831s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:06:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-f25a8843-4ec8-4613-a94d-c2dcc27256ea req-5d1f849e-8f9d-4ccb-997b-c026e1df8bbf tempest-TaggedAttachmentsTest-742391550 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-2ae86197-cb5c-4020-ab0a-5812749c9346', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10d19fdc-bee2-4973-b5bd-c88619a0ca6a', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:06:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-886b3bc9-12ea-481f-ad10-ff871cff0c9f tempest-BackendsCapabilitiesAdminTestsJSON-420618142 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6732444763184, 'free_capacity_gb': 1775.6732444763184, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93869) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 25 17:06:10 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-f25a8843-4ec8-4613-a94d-c2dcc27256ea req-5d1f849e-8f9d-4ccb-997b-c026e1df8bbf tempest-TaggedAttachmentsTest-742391550 None] attachment_update completed successfully. Jun 25 17:06:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-48c723af-aba5-4f2e-a8db-90011c10b79a tempest-BackendsCapabilitiesAdminTestsJSON-420618142 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6732444763184, 'free_capacity_gb': 1775.6732444763184, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93869) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Flow 'volume_create_manager' (bbe2b70e-d9fe-4176-b70c-490b7ca8612a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff65588-26dd-48d9-8243-9d567c4ef07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff65588-26dd-48d9-8243-9d567c4ef07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-321139834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecb35ab-8191-4bc6-bb15-0560c466cdad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf62828ee434ea890972583fafbcaaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:06:15Z,use_quota=True,user_id='3bf2f385a8b04d50851fe17d8298bf28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3260bf54-657d-4aa8-b394-842309b5d45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3260bf54-657d-4aa8-b394-842309b5d45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a45cbf-a777-46c2-b511-09a452674124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a45cbf-a777-46c2-b511-09a452674124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ecb35ab-8191-4bc6-bb15-0560c466cdad', 'volume_name': 'volume-7ecb35ab-8191-4bc6-bb15-0560c466cdad', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60f7ea7-bbb5-462b-940a-84d7f5ce6b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60f7ea7-bbb5-462b-940a-84d7f5ce6b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3d6067-433c-41bb-aece-a32e6e216136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:15 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Volume 7ecb35ab-8191-4bc6-bb15-0560c466cdad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ecb35ab-8191-4bc6-bb15-0560c466cdad', 'volume_size': 1} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:06:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-321139834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecb35ab-8191-4bc6-bb15-0560c466cdad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf62828ee434ea890972583fafbcaaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:06:15Z,use_quota=True,user_id='3bf2f385a8b04d50851fe17d8298bf28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Creating volume 7ecb35ab-8191-4bc6-bb15-0560c466cdad {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:06:15 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:06:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7ecb35ab-8191-4bc6-bb15-0560c466cdad 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:15 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7ecb35ab-8191-4bc6-bb15-0560c466cdad 1073741824 Jun 25 17:06:15 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:16 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7ecb35ab-8191-4bc6-bb15-0560c466cdad 1073741824" returned: 0 in 1.415s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7ecb35ab-8191-4bc6-bb15-0560c466cdad {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:17 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7ecb35ab-8191-4bc6-bb15-0560c466cdad Jun 25 17:06:17 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:17 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-00769b59-3225-4395-9928-d7f145536a9e req-dc410b66-f980-4363-8b5a-d740f68d9ec6 tempest-TaggedAttachmentsTest-742391550 None] Terminate volume connection completed successfully. Jun 25 17:06:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-00769b59-3225-4395-9928-d7f145536a9e req-dc410b66-f980-4363-8b5a-d740f68d9ec6 tempest-TaggedAttachmentsTest-742391550 None] Deleting attachment 10d19fdc-bee2-4973-b5bd-c88619a0ca6a. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:06:18 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7ecb35ab-8191-4bc6-bb15-0560c466cdad" returned: 0 in 1.063s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:18 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] <== create_volume: return (2564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:06:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.568s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:06:18 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3d6067-433c-41bb-aece-a32e6e216136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ecb35ab-8191-4bc6-bb15-0560c466cdad', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:18 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6bcb5f3-c4c5-4a7a-94b8-3ae8d70e7719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:18 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Volume volume-7ecb35ab-8191-4bc6-bb15-0560c466cdad (7ecb35ab-8191-4bc6-bb15-0560c466cdad): created successfully Jun 25 17:06:18 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6bcb5f3-c4c5-4a7a-94b8-3ae8d70e7719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:18 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Flow 'volume_create_manager' (bbe2b70e-d9fe-4176-b70c-490b7ca8612a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:06:18 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-2e44f449-389c-4129-bccc-5a833dd54046 tempest-ServerRescueNegativeTestJSON-744815562 None] Created volume successfully. Jun 25 17:06:19 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-52cbed44-72e8-4b48-a8ca-2735c1b20327 tempest-GroupsTest-615112411 None] Group tempest-Group1-1680295813: creating Jun 25 17:06:19 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-52cbed44-72e8-4b48-a8ca-2735c1b20327 tempest-GroupsTest-615112411 None] Group tempest-Group1-1680295813: created successfully Jun 25 17:06:19 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-52cbed44-72e8-4b48-a8ca-2735c1b20327 tempest-GroupsTest-615112411 None] Create group completed successfully. Jun 25 17:06:20 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-60f2cd4a-e664-4b6d-a407-2de3d411c942 tempest-GroupsTest-615112411 None] Group tempest-Group2-1786784041: creating Jun 25 17:06:20 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-60f2cd4a-e664-4b6d-a407-2de3d411c942 tempest-GroupsTest-615112411 None] Group tempest-Group2-1786784041: created successfully Jun 25 17:06:20 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-60f2cd4a-e664-4b6d-a407-2de3d411c942 tempest-GroupsTest-615112411 None] Create group completed successfully. Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Flow 'volume_create_manager' (b7144c5e-3f60-4c37-a29d-ec5f35e17e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d967a4-7d9a-41ab-a711-b3c51f4c8e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d967a4-7d9a-41ab-a711-b3c51f4c8e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-834338694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0a80e96-20a9-496b-9c31-0270194e091a,host='devstack@QuobyteHD#QuobyteHD',id=5eee161b-54f3-4a21-ad91-856289be5456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213a2d5beb6d401dad9b2e800cb8019a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:06:23Z,use_quota=True,user_id='d231d5d8562b4b60a416150c89b5dcb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f3563d4-8845-4a4f-ac87-091fd312a074),volume_type_id=8f3563d4-8845-4a4f-ac87-091fd312a074)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9550262d-057f-4aa0-8c9e-e462d6509f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9550262d-057f-4aa0-8c9e-e462d6509f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef54c880-f5cd-464b-9c8b-b8612970efbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef54c880-f5cd-464b-9c8b-b8612970efbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eee161b-54f3-4a21-ad91-856289be5456', 'volume_name': 'volume-5eee161b-54f3-4a21-ad91-856289be5456', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69827893-0dc1-4e05-a289-7fe7b8a86fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69827893-0dc1-4e05-a289-7fe7b8a86fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d1a23a6-3e13-4331-88b0-8e7c30a43eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:23 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Volume 5eee161b-54f3-4a21-ad91-856289be5456: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eee161b-54f3-4a21-ad91-856289be5456', 'volume_size': 1} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f0a80e96-20a9-496b-9c31-0270194e091a,created_at=2026-06-25T15:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-834338694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0a80e96-20a9-496b-9c31-0270194e091a,host='devstack@QuobyteHD#QuobyteHD',id=5eee161b-54f3-4a21-ad91-856289be5456,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213a2d5beb6d401dad9b2e800cb8019a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:06:23Z,use_quota=True,user_id='d231d5d8562b4b60a416150c89b5dcb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f3563d4-8845-4a4f-ac87-091fd312a074),volume_type_id=8f3563d4-8845-4a4f-ac87-091fd312a074)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Creating volume 5eee161b-54f3-4a21-ad91-856289be5456 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:06:23 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:06:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5eee161b-54f3-4a21-ad91-856289be5456 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:23 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5eee161b-54f3-4a21-ad91-856289be5456 1073741824 Jun 25 17:06:23 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:24 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5eee161b-54f3-4a21-ad91-856289be5456 1073741824" returned: 0 in 1.192s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5eee161b-54f3-4a21-ad91-856289be5456 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:25 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5eee161b-54f3-4a21-ad91-856289be5456 Jun 25 17:06:25 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:25 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5eee161b-54f3-4a21-ad91-856289be5456" returned: 0 in 0.898s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] <== create_volume: return (2186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:06:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.190s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:06:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d1a23a6-3e13-4331-88b0-8e7c30a43eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eee161b-54f3-4a21-ad91-856289be5456', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6970cd2c-5008-44a9-80b4-7f33c6993349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:26 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Volume volume-5eee161b-54f3-4a21-ad91-856289be5456 (5eee161b-54f3-4a21-ad91-856289be5456): created successfully Jun 25 17:06:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6970cd2c-5008-44a9-80b4-7f33c6993349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Flow 'volume_create_manager' (b7144c5e-3f60-4c37-a29d-ec5f35e17e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:06:26 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-87211444-4cd3-4e7e-81b1-ca9fdbba1dba tempest-GroupsTest-615112411 None] Created volume successfully. Jun 25 17:06:28 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] Acquiring lock "cinder-quobyte-5eee161b-54f3-4a21-ad91-856289be5456" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:06:28 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] Lock "cinder-quobyte-5eee161b-54f3-4a21-ad91-856289be5456" acquired by "delete_volume" :: waited 0.018s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:06:28 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64937d1-7d8a-4d86-afe4-812d4666bb0a]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:06:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5eee161b-54f3-4a21-ad91-856289be5456 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:28 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5eee161b-54f3-4a21-ad91-856289be5456 Jun 25 17:06:28 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:29 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5eee161b-54f3-4a21-ad91-856289be5456" returned: 0 in 1.293s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5eee161b-54f3-4a21-ad91-856289be5456 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:29 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5eee161b-54f3-4a21-ad91-856289be5456 Jun 25 17:06:29 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:31 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5eee161b-54f3-4a21-ad91-856289be5456" returned: 0 in 1.563s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:31 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] Lock "cinder-quobyte-5eee161b-54f3-4a21-ad91-856289be5456" released by "delete_volume" :: held 2.924s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:06:31 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] Created reservations ['8621570c-f00c-44d3-88bf-cee4eabacb98'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:06:31 devstack cinder-volume[93869]: WARNING cinder.quota [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1785603365 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1785603365, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:06:31 devstack cinder-volume[93869]: WARNING cinder.quota [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1785603365 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1785603365, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:06:31 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] Created reservations ['424f27c2-52e1-44dc-a71d-ba1997424de2', '98efc462-5e51-4d48-a6c6-67b1ac6ba8d2', '0b68340a-baaf-4714-83fb-dcabb8e8baa9', 'b323712b-16d0-4bc8-83c0-4ac5f301934e'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:06:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:06:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:06:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:06:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:06:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:06:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:31 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:06:31 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:32 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-c56af897-bee5-4171-b334-2148962c5669 tempest-GroupsTest-615112411 None] Created reservations ['6727ecdb-c191-4d1c-91d2-dd494e872400'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:06:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c56af897-bee5-4171-b334-2148962c5669 tempest-GroupsTest-615112411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:06:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c56af897-bee5-4171-b334-2148962c5669 tempest-GroupsTest-615112411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:06:32 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c56af897-bee5-4171-b334-2148962c5669 tempest-GroupsTest-615112411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:06:32 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c56af897-bee5-4171-b334-2148962c5669 tempest-GroupsTest-615112411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:06:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c56af897-bee5-4171-b334-2148962c5669 tempest-GroupsTest-615112411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:06:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c56af897-bee5-4171-b334-2148962c5669 tempest-GroupsTest-615112411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:32 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:06:32 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:33 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.590s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:33 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:06:33 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-313f14d1-0966-4b91-9b4c-189f087322df tempest-GroupsTest-615112411 None] Delete group completed successfully. Jun 25 17:06:34 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c56af897-bee5-4171-b334-2148962c5669 tempest-GroupsTest-615112411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.634s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:34 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-c56af897-bee5-4171-b334-2148962c5669 tempest-GroupsTest-615112411 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:06:34 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-c56af897-bee5-4171-b334-2148962c5669 tempest-GroupsTest-615112411 None] Delete group completed successfully. Jun 25 17:06:34 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-99de972a-b181-4707-a9eb-e3f005ddd079 tempest-GroupsTest-615112411 None] Group tempest-GroupsTest-Group-1494377004: creating Jun 25 17:06:34 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-99de972a-b181-4707-a9eb-e3f005ddd079 tempest-GroupsTest-615112411 None] Group tempest-GroupsTest-Group-1494377004: created successfully Jun 25 17:06:35 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-99de972a-b181-4707-a9eb-e3f005ddd079 tempest-GroupsTest-615112411 None] Create group completed successfully. Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Flow 'volume_create_manager' (2531d2e8-221d-4c0e-8cde-4fa786164128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999bd77f-27ca-4579-9dc4-c4c4aedce133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999bd77f-27ca-4579-9dc4-c4c4aedce133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1567881395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58567f22-6e97-4258-84f2-01475a7ab48f,host='devstack@QuobyteHD#QuobyteHD',id=c0b462b6-4faf-4d73-a052-1cb330dcd1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213a2d5beb6d401dad9b2e800cb8019a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:06:37Z,use_quota=True,user_id='d231d5d8562b4b60a416150c89b5dcb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5b45d1e-a252-4903-9685-7760438f7b16),volume_type_id=c5b45d1e-a252-4903-9685-7760438f7b16)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83701dd7-e63f-488a-9e82-00df69500762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83701dd7-e63f-488a-9e82-00df69500762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44860a6-32d8-406c-a9a3-63d400caaefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44860a6-32d8-406c-a9a3-63d400caaefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0b462b6-4faf-4d73-a052-1cb330dcd1c4', 'volume_name': 'volume-c0b462b6-4faf-4d73-a052-1cb330dcd1c4', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3cf22f-5458-4a6f-9fce-d2430377a1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3cf22f-5458-4a6f-9fce-d2430377a1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c9519c-e145-431d-9f70-ff7897b48b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:37 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Volume c0b462b6-4faf-4d73-a052-1cb330dcd1c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0b462b6-4faf-4d73-a052-1cb330dcd1c4', 'volume_size': 1} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=58567f22-6e97-4258-84f2-01475a7ab48f,created_at=2026-06-25T15:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1567881395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58567f22-6e97-4258-84f2-01475a7ab48f,host='devstack@QuobyteHD#QuobyteHD',id=c0b462b6-4faf-4d73-a052-1cb330dcd1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213a2d5beb6d401dad9b2e800cb8019a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:06:37Z,use_quota=True,user_id='d231d5d8562b4b60a416150c89b5dcb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5b45d1e-a252-4903-9685-7760438f7b16),volume_type_id=c5b45d1e-a252-4903-9685-7760438f7b16)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Creating volume c0b462b6-4faf-4d73-a052-1cb330dcd1c4 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:06:37 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:06:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c0b462b6-4faf-4d73-a052-1cb330dcd1c4 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:37 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c0b462b6-4faf-4d73-a052-1cb330dcd1c4 1073741824 Jun 25 17:06:37 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:38 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c0b462b6-4faf-4d73-a052-1cb330dcd1c4 1073741824" returned: 0 in 1.516s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c0b462b6-4faf-4d73-a052-1cb330dcd1c4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:38 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c0b462b6-4faf-4d73-a052-1cb330dcd1c4 Jun 25 17:06:38 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:39 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c0b462b6-4faf-4d73-a052-1cb330dcd1c4" returned: 0 in 0.953s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] <== create_volume: return (2528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:06:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.532s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:06:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c9519c-e145-431d-9f70-ff7897b48b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0b462b6-4faf-4d73-a052-1cb330dcd1c4', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211c210c-6921-4dbd-9b78-51349602a799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:39 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=41,cinder:SELECT=45,cinder:INSERT=12,cinder:DELETE=2 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:06:39 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Volume volume-c0b462b6-4faf-4d73-a052-1cb330dcd1c4 (c0b462b6-4faf-4d73-a052-1cb330dcd1c4): created successfully Jun 25 17:06:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (211c210c-6921-4dbd-9b78-51349602a799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Flow 'volume_create_manager' (2531d2e8-221d-4c0e-8cde-4fa786164128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:06:39 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-a4221ac5-49ed-4015-aed2-649c196fea94 tempest-GroupsTest-615112411 None] Created volume successfully. Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=49,cinder:INSERT=7,cinder:UPDATE=48,cinder:DELETE=4 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Flow 'volume_create_manager' (0a22a174-e174-4e8f-bd35-388d45304c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82663fbb-3eed-46c9-bb9e-376cdbb5fcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] Acquiring lock "cinder-7ecb35ab-8191-4bc6-bb15-0560c466cdad-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82663fbb-3eed-46c9-bb9e-376cdbb5fcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-854234303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58567f22-6e97-4258-84f2-01475a7ab48f,host='devstack@QuobyteHD#QuobyteHD',id=cd1f794b-f00e-42e0-b520-0f3cc52651e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213a2d5beb6d401dad9b2e800cb8019a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:06:42Z,use_quota=True,user_id='d231d5d8562b4b60a416150c89b5dcb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5b45d1e-a252-4903-9685-7760438f7b16),volume_type_id=c5b45d1e-a252-4903-9685-7760438f7b16)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (862a8424-4365-485f-86dd-877165069e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (862a8424-4365-485f-86dd-877165069e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd53449-f04f-4a54-a7f0-10c1f5220f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dd53449-f04f-4a54-a7f0-10c1f5220f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd1f794b-f00e-42e0-b520-0f3cc52651e3', 'volume_name': 'volume-cd1f794b-f00e-42e0-b520-0f3cc52651e3', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333bd6f5-17ab-43ce-a381-4d9b9551d20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333bd6f5-17ab-43ce-a381-4d9b9551d20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37794745-aab5-484e-ba50-b3d8c58d5e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:42 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Volume cd1f794b-f00e-42e0-b520-0f3cc52651e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd1f794b-f00e-42e0-b520-0f3cc52651e3', 'volume_size': 1} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=58567f22-6e97-4258-84f2-01475a7ab48f,created_at=2026-06-25T15:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-854234303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58567f22-6e97-4258-84f2-01475a7ab48f,host='devstack@QuobyteHD#QuobyteHD',id=cd1f794b-f00e-42e0-b520-0f3cc52651e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='213a2d5beb6d401dad9b2e800cb8019a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:06:42Z,use_quota=True,user_id='d231d5d8562b4b60a416150c89b5dcb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5b45d1e-a252-4903-9685-7760438f7b16),volume_type_id=c5b45d1e-a252-4903-9685-7760438f7b16)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Creating volume cd1f794b-f00e-42e0-b520-0f3cc52651e3 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:06:42 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cd1f794b-f00e-42e0-b520-0f3cc52651e3 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] Lock "cinder-7ecb35ab-8191-4bc6-bb15-0560c466cdad-delete_volume" acquired by "delete_volume" :: waited 0.179s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:06:42 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cd1f794b-f00e-42e0-b520-0f3cc52651e3 1073741824 Jun 25 17:06:42 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] Acquiring lock "cinder-quobyte-7ecb35ab-8191-4bc6-bb15-0560c466cdad" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] Lock "cinder-quobyte-7ecb35ab-8191-4bc6-bb15-0560c466cdad" acquired by "delete_volume" :: waited 0.030s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd9fa99-5e1b-4ed1-8011-c17fa1f6e0cf]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:06:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7ecb35ab-8191-4bc6-bb15-0560c466cdad {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:43 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7ecb35ab-8191-4bc6-bb15-0560c466cdad Jun 25 17:06:43 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:06:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:06:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:06:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:06:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:06:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:06:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:44 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cd1f794b-f00e-42e0-b520-0f3cc52651e3 1073741824" returned: 0 in 1.547s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:44 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:06:44 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cd1f794b-f00e-42e0-b520-0f3cc52651e3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:44 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cd1f794b-f00e-42e0-b520-0f3cc52651e3 Jun 25 17:06:44 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:44 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7ecb35ab-8191-4bc6-bb15-0560c466cdad" returned: 0 in 2.074s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7ecb35ab-8191-4bc6-bb15-0560c466cdad {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:45 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7ecb35ab-8191-4bc6-bb15-0560c466cdad Jun 25 17:06:45 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:45 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] Acquiring lock "cinder-2ae86197-cb5c-4020-ab0a-5812749c9346-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:06:45 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] Lock "cinder-2ae86197-cb5c-4020-ab0a-5812749c9346-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:06:45 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] Acquiring lock "cinder-quobyte-2ae86197-cb5c-4020-ab0a-5812749c9346" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:06:45 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] Lock "cinder-quobyte-2ae86197-cb5c-4020-ab0a-5812749c9346" acquired by "delete_volume" :: waited 0.038s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:06:45 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cd1f794b-f00e-42e0-b520-0f3cc52651e3" returned: 0 in 1.247s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] <== create_volume: return (2889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:06:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.909s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:06:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37794745-aab5-484e-ba50-b3d8c58d5e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd1f794b-f00e-42e0-b520-0f3cc52651e3', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f94b1a-0616-4592-962c-075615597159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:06:45 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6678e2-4610-43df-ae2f-ef4b6dc52919]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:06:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ae86197-cb5c-4020-ab0a-5812749c9346 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:45 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Volume volume-cd1f794b-f00e-42e0-b520-0f3cc52651e3 (cd1f794b-f00e-42e0-b520-0f3cc52651e3): created successfully Jun 25 17:06:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f94b1a-0616-4592-962c-075615597159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:06:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Flow 'volume_create_manager' (0a22a174-e174-4e8f-bd35-388d45304c41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:06:45 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-bc9a5ac4-9783-4363-aa31-9e81306025c9 tempest-GroupsTest-615112411 None] Created volume successfully. Jun 25 17:06:45 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ae86197-cb5c-4020-ab0a-5812749c9346 Jun 25 17:06:45 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:45 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.737s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:06:46 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7ecb35ab-8191-4bc6-bb15-0560c466cdad" returned: 0 in 1.233s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:46 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] Lock "cinder-quobyte-7ecb35ab-8191-4bc6-bb15-0560c466cdad" released by "delete_volume" :: held 3.362s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:06:46 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] Created reservations ['8ba25ef3-8146-492e-a1d7-e69f8ff39677', '078816fd-5490-47a0-8a80-5a57af9b4a11', '52e7c63c-d274-477b-9779-16092f09d295', 'd54698fe-be1b-4a87-afe3-9c3c690f4489'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:06:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:06:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:06:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:06:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:06:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:06:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:46 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:06:46 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:46 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ae86197-cb5c-4020-ab0a-5812749c9346" returned: 0 in 0.958s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ae86197-cb5c-4020-ab0a-5812749c9346 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:46 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ae86197-cb5c-4020-ab0a-5812749c9346 Jun 25 17:06:46 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:47 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-7f070a88-2c84-463f-81bf-59a9eedd6d57 tempest-GroupsTest-615112411 None] Update group completed successfully. Jun 25 17:06:47 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.035s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:47 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:06:47 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] Deleted volume successfully. Jun 25 17:06:47 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-baec233e-1dac-4082-8cc8-b33bbd49d8b5 tempest-ServerRescueNegativeTestJSON-744815562 None] Lock "cinder-7ecb35ab-8191-4bc6-bb15-0560c466cdad-delete_volume" released by "delete_volume" :: held 4.669s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:06:47 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ae86197-cb5c-4020-ab0a-5812749c9346" returned: 0 in 1.069s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:47 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] Lock "cinder-quobyte-2ae86197-cb5c-4020-ab0a-5812749c9346" released by "delete_volume" :: held 2.114s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:06:47 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] Created reservations ['f0aa9ffa-9103-4b58-abdd-f1c3de0f5f0f', '457d125e-b13f-442c-bafc-8de966a9c8c3', '0fe0f19a-2575-4084-8526-68e5622e137d', 'f139995c-4472-4b57-a8f0-132ed5b14cfb'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:06:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:06:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:06:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:06:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:06:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:06:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:47 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:06:47 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:48 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.859s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:48 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:06:48 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] Deleted volume successfully. Jun 25 17:06:48 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76ba2923-524d-46fb-abe0-a2d479a3c997 tempest-TaggedAttachmentsTest-742391550 None] Lock "cinder-2ae86197-cb5c-4020-ab0a-5812749c9346-delete_volume" released by "delete_volume" :: held 3.324s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:06:49 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-69849431-4c10-4218-91c1-12a39b211c6b tempest-GroupsTest-615112411 None] Update group completed successfully. Jun 25 17:06:51 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Acquiring lock "cinder-quobyte-c0b462b6-4faf-4d73-a052-1cb330dcd1c4" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:06:51 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Lock "cinder-quobyte-c0b462b6-4faf-4d73-a052-1cb330dcd1c4" acquired by "delete_volume" :: waited 0.029s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:06:51 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2b0e12-8d50-4f67-ac11-769a3438b4e4]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:06:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c0b462b6-4faf-4d73-a052-1cb330dcd1c4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:51 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c0b462b6-4faf-4d73-a052-1cb330dcd1c4 Jun 25 17:06:51 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:52 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c0b462b6-4faf-4d73-a052-1cb330dcd1c4" returned: 0 in 1.063s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c0b462b6-4faf-4d73-a052-1cb330dcd1c4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:52 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c0b462b6-4faf-4d73-a052-1cb330dcd1c4 Jun 25 17:06:52 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:53 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c0b462b6-4faf-4d73-a052-1cb330dcd1c4" returned: 0 in 0.939s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:53 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Lock "cinder-quobyte-c0b462b6-4faf-4d73-a052-1cb330dcd1c4" released by "delete_volume" :: held 2.085s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:06:53 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Acquiring lock "cinder-quobyte-cd1f794b-f00e-42e0-b520-0f3cc52651e3" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:06:53 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Lock "cinder-quobyte-cd1f794b-f00e-42e0-b520-0f3cc52651e3" acquired by "delete_volume" :: waited 0.042s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:06:53 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e524348-c2fe-494f-a10d-a80def88b015]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:06:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cd1f794b-f00e-42e0-b520-0f3cc52651e3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:53 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cd1f794b-f00e-42e0-b520-0f3cc52651e3 Jun 25 17:06:53 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:54 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cd1f794b-f00e-42e0-b520-0f3cc52651e3" returned: 0 in 1.244s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cd1f794b-f00e-42e0-b520-0f3cc52651e3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:54 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cd1f794b-f00e-42e0-b520-0f3cc52651e3 Jun 25 17:06:54 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:55 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cd1f794b-f00e-42e0-b520-0f3cc52651e3" returned: 0 in 0.954s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:55 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Lock "cinder-quobyte-cd1f794b-f00e-42e0-b520-0f3cc52651e3" released by "delete_volume" :: held 2.295s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:06:55 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Created reservations ['31e0071b-3a94-47b1-89f5-40ca0f612ff5'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:06:56 devstack cinder-volume[93869]: WARNING cinder.quota [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1276849391 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1276849391, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:06:56 devstack cinder-volume[93869]: WARNING cinder.quota [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1276849391 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1276849391, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:06:56 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Created reservations ['fab4e43d-277a-43d2-8398-41ef49ef327e', 'aa056f3a-3c0d-4466-862e-cfda52c1076e', 'a053ebb9-099d-40da-bed9-9904496a96f4', '1e93a8a4-91d7-4c72-92b1-fa4174db9e9c'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:06:56 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Created reservations ['9ffafebe-30a3-439c-97a7-6f15608ed73a', '442e5645-1b93-4231-baa9-8eaa20313357', '65d8e1cb-d025-43a6-9fda-0e677829cb90', 'b57ff679-b582-46f6-ab9e-bc95da11b8d1'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:06:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:06:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:06:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:06:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:06:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:06:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:06:56 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:06:56 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:06:57 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Jun 25 17:06:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.999s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:06:57 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:06:57 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-29d43c00-5978-4273-b7eb-20d736d5ad89 tempest-GroupsTest-615112411 None] Delete group completed successfully. Jun 25 17:07:04 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-c321080d-84a8-46a9-87ea-c696cdca1d26 tempest-GroupsV320Test-1329069929 None] Group tempest-GroupsV320Test-Group-1413944534: creating Jun 25 17:07:04 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-c321080d-84a8-46a9-87ea-c696cdca1d26 tempest-GroupsV320Test-1329069929 None] Group tempest-GroupsV320Test-Group-1413944534: created successfully Jun 25 17:07:04 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-c321080d-84a8-46a9-87ea-c696cdca1d26 tempest-GroupsV320Test-1329069929 None] Create group completed successfully. Jun 25 17:07:06 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-0deb4329-fbe9-41a2-9394-5cee961c4c1f tempest-GroupsV320Test-1329069929 None] Created reservations ['69c45469-af8f-432a-bd64-093eb407aa71'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:07:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0deb4329-fbe9-41a2-9394-5cee961c4c1f tempest-GroupsV320Test-1329069929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:07:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0deb4329-fbe9-41a2-9394-5cee961c4c1f tempest-GroupsV320Test-1329069929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:07:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-0deb4329-fbe9-41a2-9394-5cee961c4c1f tempest-GroupsV320Test-1329069929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:07:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-0deb4329-fbe9-41a2-9394-5cee961c4c1f tempest-GroupsV320Test-1329069929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:07:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0deb4329-fbe9-41a2-9394-5cee961c4c1f tempest-GroupsV320Test-1329069929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:07:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0deb4329-fbe9-41a2-9394-5cee961c4c1f tempest-GroupsV320Test-1329069929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:06 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:07:06 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:07 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0deb4329-fbe9-41a2-9394-5cee961c4c1f tempest-GroupsV320Test-1329069929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.143s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:07 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-0deb4329-fbe9-41a2-9394-5cee961c4c1f tempest-GroupsV320Test-1329069929 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:07:07 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-0deb4329-fbe9-41a2-9394-5cee961c4c1f tempest-GroupsV320Test-1329069929 None] Delete group completed successfully. Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Flow 'volume_create_manager' (622ffb7a-d8f1-4cbf-92ff-cea520c57b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fdb7e4-a72d-4382-a9d6-411e2d43e46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41fdb7e4-a72d-4382-a9d6-411e2d43e46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1187571925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c0ec8a-728c-43b1-b713-4b994cdcaa7a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0f60eb2f4e7b44998abe809d3bad4ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:07:14Z,use_quota=True,user_id='6c88fd23edac46beaa2b2367b5fdbb02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae21c65-0d50-416a-ad34-785390b29f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae21c65-0d50-416a-ad34-785390b29f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e86ef3b-2ae9-4ce8-931e-75126d5b73b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e86ef3b-2ae9-4ce8-931e-75126d5b73b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3c0ec8a-728c-43b1-b713-4b994cdcaa7a', 'volume_name': 'volume-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f85b649-2910-4571-b705-fe788591abdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f85b649-2910-4571-b705-fe788591abdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca6a656-ff48-4996-a90b-e20a7a8f24fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:07:14 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Volume d3c0ec8a-728c-43b1-b713-4b994cdcaa7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a', 'volume_size': 1} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:07:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1187571925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c0ec8a-728c-43b1-b713-4b994cdcaa7a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0f60eb2f4e7b44998abe809d3bad4ebd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:07:14Z,use_quota=True,user_id='6c88fd23edac46beaa2b2367b5fdbb02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Creating volume d3c0ec8a-728c-43b1-b713-4b994cdcaa7a {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:07:14 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:07:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:14 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a 1073741824 Jun 25 17:07:14 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:15 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a 1073741824" returned: 0 in 1.383s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:15 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a Jun 25 17:07:15 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Flow 'volume_create_manager' (8c001566-1764-41ab-8aa4-19070cbcff84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea59afb-dfb1-46c2-861b-3a838d8368b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea59afb-dfb1-46c2-861b-3a838d8368b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1461175687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a6664c-1685-4ebc-8cff-702a5780a2ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4d951c416240e9bcf59206d89db8a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:07:16Z,use_quota=True,user_id='ca92e0fe399742b4a2fccbde98415925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33f97276-f425-4de3-aef0-950bd6f1d847),volume_type_id=33f97276-f425-4de3-aef0-950bd6f1d847)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f637c7f-f7cf-4f6e-9424-d405ff06e0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f637c7f-f7cf-4f6e-9424-d405ff06e0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11508eed-87a9-4d46-8730-af55755ba309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11508eed-87a9-4d46-8730-af55755ba309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04a6664c-1685-4ebc-8cff-702a5780a2ce', 'volume_name': 'volume-04a6664c-1685-4ebc-8cff-702a5780a2ce', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625deb62-8d69-49c2-ac4c-5e6e9e968d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625deb62-8d69-49c2-ac4c-5e6e9e968d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772587fe-fa7b-4f78-9f69-bef8165b9f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:07:16 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Volume 04a6664c-1685-4ebc-8cff-702a5780a2ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04a6664c-1685-4ebc-8cff-702a5780a2ce', 'volume_size': 1} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:07:16 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a" returned: 0 in 1.143s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] <== create_volume: return (2580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.584s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.256s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:07:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1461175687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a6664c-1685-4ebc-8cff-702a5780a2ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c4d951c416240e9bcf59206d89db8a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:07:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:07:16Z,use_quota=True,user_id='ca92e0fe399742b4a2fccbde98415925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(33f97276-f425-4de3-aef0-950bd6f1d847),volume_type_id=33f97276-f425-4de3-aef0-950bd6f1d847)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Creating volume 04a6664c-1685-4ebc-8cff-702a5780a2ce {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:07:16 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04a6664c-1685-4ebc-8cff-702a5780a2ce 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eca6a656-ff48-4996-a90b-e20a7a8f24fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6290d073-15b2-4a47-a1ac-35774e7b16dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:07:16 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04a6664c-1685-4ebc-8cff-702a5780a2ce 1073741824 Jun 25 17:07:16 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:16 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Volume volume-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a (d3c0ec8a-728c-43b1-b713-4b994cdcaa7a): created successfully Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6290d073-15b2-4a47-a1ac-35774e7b16dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:07:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Flow 'volume_create_manager' (622ffb7a-d8f1-4cbf-92ff-cea520c57b0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:07:16 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-6dc9ee44-283f-4ac0-8885-cf72ff610305 req-d2b0d12e-9d15-43e7-9a72-81947e501707 tempest-VolumesGetTestJSON-357747305 None] Created volume successfully. Jun 25 17:07:18 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] Acquiring lock "cinder-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:07:18 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] Lock "cinder-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:07:18 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] Acquiring lock "cinder-quobyte-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:07:18 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] Lock "cinder-quobyte-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a" acquired by "delete_volume" :: waited 0.034s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:07:18 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:18 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93bc7ae-ca87-4cd7-81f5-27ade3c329af]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:07:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04a6664c-1685-4ebc-8cff-702a5780a2ce 1073741824" returned: 0 in 1.472s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04a6664c-1685-4ebc-8cff-702a5780a2ce {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:18 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04a6664c-1685-4ebc-8cff-702a5780a2ce Jun 25 17:07:18 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:18 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a Jun 25 17:07:18 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:19 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04a6664c-1685-4ebc-8cff-702a5780a2ce" returned: 0 in 0.725s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:19 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] <== create_volume: return (2313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:07:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.316s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:07:19 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772587fe-fa7b-4f78-9f69-bef8165b9f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04a6664c-1685-4ebc-8cff-702a5780a2ce', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:07:19 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea94790-2c5d-4db2-a571-380f7b5cda28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:07:19 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Volume volume-04a6664c-1685-4ebc-8cff-702a5780a2ce (04a6664c-1685-4ebc-8cff-702a5780a2ce): created successfully Jun 25 17:07:19 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ea94790-2c5d-4db2-a571-380f7b5cda28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:07:19 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Flow 'volume_create_manager' (8c001566-1764-41ab-8aa4-19070cbcff84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:07:19 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-c92bd529-14da-44db-be1a-df03ec67037f tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Created volume successfully. Jun 25 17:07:19 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a" returned: 0 in 0.934s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:19 devstack sudo[100061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a Jun 25 17:07:19 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:20 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a" returned: 0 in 0.864s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] Lock "cinder-quobyte-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a" released by "delete_volume" :: held 1.878s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:07:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-57a9b502-20b5-434f-836a-601a0dc1c7c3 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:07:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-57a9b502-20b5-434f-836a-601a0dc1c7c3 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:07:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-57a9b502-20b5-434f-836a-601a0dc1c7c3 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:07:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-57a9b502-20b5-434f-836a-601a0dc1c7c3 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:07:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-57a9b502-20b5-434f-836a-601a0dc1c7c3 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:07:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-57a9b502-20b5-434f-836a-601a0dc1c7c3 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:20 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:07:20 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:20 devstack cinder-volume[93869]: DEBUG cinder.quota [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] Created reservations ['aace32da-1d62-4652-bc5e-c5856c002ffd', '07b38de5-584c-4ce1-a551-b35e4e9d77db', '75f73cd4-acb1-4585-9981-02b4d523b7ed', 'd5546159-68e7-4cda-a6b0-03b2865b4367'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:07:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:07:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:07:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:07:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:07:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:07:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:20 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:07:20 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:21 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-57a9b502-20b5-434f-836a-601a0dc1c7c3 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.930s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:21 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-57a9b502-20b5-434f-836a-601a0dc1c7c3 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:07:21 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-57a9b502-20b5-434f-836a-601a0dc1c7c3 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Retype volume completed successfully. Jun 25 17:07:21 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.915s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:21 devstack cinder-volume[93869]: DEBUG cinder.manager [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:07:21 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] Deleted volume successfully. Jun 25 17:07:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-784b62fb-348a-48ca-be00-51c6bb65a4eb req-a7347347-1338-480c-b318-72a917da6e9a tempest-VolumesGetTestJSON-357747305 None] Lock "cinder-d3c0ec8a-728c-43b1-b713-4b994cdcaa7a-delete_volume" released by "delete_volume" :: held 3.261s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:07:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Acquiring lock "cinder-04a6664c-1685-4ebc-8cff-702a5780a2ce-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:07:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Lock "cinder-04a6664c-1685-4ebc-8cff-702a5780a2ce-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:07:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Acquiring lock "cinder-quobyte-04a6664c-1685-4ebc-8cff-702a5780a2ce" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:07:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Lock "cinder-quobyte-04a6664c-1685-4ebc-8cff-702a5780a2ce" acquired by "delete_volume" :: waited 0.017s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:07:21 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f9ae4b-9360-4442-b2c0-28d370940604]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:07:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04a6664c-1685-4ebc-8cff-702a5780a2ce {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:21 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04a6664c-1685-4ebc-8cff-702a5780a2ce Jun 25 17:07:21 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:22 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04a6664c-1685-4ebc-8cff-702a5780a2ce" returned: 0 in 0.913s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04a6664c-1685-4ebc-8cff-702a5780a2ce {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:22 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04a6664c-1685-4ebc-8cff-702a5780a2ce Jun 25 17:07:22 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:23 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04a6664c-1685-4ebc-8cff-702a5780a2ce" returned: 0 in 0.816s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Lock "cinder-quobyte-04a6664c-1685-4ebc-8cff-702a5780a2ce" released by "delete_volume" :: held 1.780s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:07:23 devstack cinder-volume[93869]: WARNING cinder.quota [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:07:23 devstack cinder-volume[93869]: WARNING cinder.quota [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:07:23 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Created reservations ['c56f9b34-18e4-4255-ba59-f654d9ccadf7', '48975f4f-1e42-48af-881a-291189fe62e0', '71d9afea-89b5-4817-921c-dc9acabba6a2', 'facbf093-57cc-4dd7-b602-0745a9005ec1'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:07:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:07:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:07:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:07:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:07:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:07:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:23 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:07:23 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:24 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.096s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:24 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:07:24 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Deleted volume successfully. Jun 25 17:07:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e48bb385-2424-4da8-9445-c33f25ca2589 tempest-VolumeRetypeWithoutMigrationTest-748064759 None] Lock "cinder-04a6664c-1685-4ebc-8cff-702a5780a2ce-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:07:26 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b5a80765-1e0b-4225-acd3-15175d06e9af tempest-GroupSnapshotsV319Test-770630235 None] Group tempest-GroupSnapshotsV319Test-Group-839902670: creating Jun 25 17:07:26 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b5a80765-1e0b-4225-acd3-15175d06e9af tempest-GroupSnapshotsV319Test-770630235 None] Group tempest-GroupSnapshotsV319Test-Group-839902670: created successfully Jun 25 17:07:26 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b5a80765-1e0b-4225-acd3-15175d06e9af tempest-GroupSnapshotsV319Test-770630235 None] Create group completed successfully. Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Flow 'volume_create_manager' (ec4fcd17-ac8f-4b75-a475-0909695e56b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665fb421-3787-41c1-968a-6cc181438548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (665fb421-3787-41c1-968a-6cc181438548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-698710033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9de77001-926f-4eb3-9d24-ae5639a50ee5,host='devstack@QuobyteHD#QuobyteHD',id=208d8d01-0563-4359-bbbc-e9b1381f2f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b39d00af7a47419c8ab3703a62f27c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:07:28Z,use_quota=True,user_id='d50ccc14a6124eb3a587e1471510a9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac0b04eb-c342-4562-b74a-9b5383550042),volume_type_id=ac0b04eb-c342-4562-b74a-9b5383550042)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5a2fbd-486d-4a1a-8ebd-630e0d3c70cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e5a2fbd-486d-4a1a-8ebd-630e0d3c70cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8ff177-958e-4df6-8301-310ef03f75ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8ff177-958e-4df6-8301-310ef03f75ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '208d8d01-0563-4359-bbbc-e9b1381f2f9a', 'volume_name': 'volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e59741-8045-402d-9414-86fe0a1566a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e59741-8045-402d-9414-86fe0a1566a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f8c249-59d5-437d-aeb8-bc3eec61259f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:07:28 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Volume 208d8d01-0563-4359-bbbc-e9b1381f2f9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a', 'volume_size': 1} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9de77001-926f-4eb3-9d24-ae5639a50ee5,created_at=2026-06-25T15:07:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-698710033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9de77001-926f-4eb3-9d24-ae5639a50ee5,host='devstack@QuobyteHD#QuobyteHD',id=208d8d01-0563-4359-bbbc-e9b1381f2f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b39d00af7a47419c8ab3703a62f27c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:07:28Z,use_quota=True,user_id='d50ccc14a6124eb3a587e1471510a9f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac0b04eb-c342-4562-b74a-9b5383550042),volume_type_id=ac0b04eb-c342-4562-b74a-9b5383550042)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Creating volume 208d8d01-0563-4359-bbbc-e9b1381f2f9a {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:07:28 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:07:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:28 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a 1073741824 Jun 25 17:07:28 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:29 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a 1073741824" returned: 0 in 1.249s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:29 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a Jun 25 17:07:29 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:30 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a" returned: 0 in 0.971s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:30 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] <== create_volume: return (2287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:07:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.292s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:07:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f8c249-59d5-437d-aeb8-bc3eec61259f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:07:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd3ad48-0f4f-4b58-9efb-f5ddc193be92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:07:30 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Volume volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a (208d8d01-0563-4359-bbbc-e9b1381f2f9a): created successfully Jun 25 17:07:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd3ad48-0f4f-4b58-9efb-f5ddc193be92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:07:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Flow 'volume_create_manager' (ec4fcd17-ac8f-4b75-a475-0909695e56b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:07:30 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-af55673f-7dcb-4ed0-83b1-930971e9b6cf tempest-GroupSnapshotsV319Test-770630235 None] Created volume successfully. Jun 25 17:07:32 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] GroupSnapshot 76b9f6f3-4034-48a2-8439-3e802d6bfaaa: creating. Jun 25 17:07:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] Group snapshot 76b9f6f3-4034-48a2-8439-3e802d6bfaaa: creating. {{(pid=93869) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 25 17:07:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:07:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:07:32 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] Creating offline snapshot 65e912b1-f856-422e-b88e-e7aee9a0183b of volume 208d8d01-0563-4359-bbbc-e9b1381f2f9a {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:07:32 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[00db0efb-9d21-4efd-a205-76ee1f038d9a]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:07:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:32 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a Jun 25 17:07:32 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:33 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a" returned: 0 in 1.194s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:33 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b 1G Jun 25 17:07:33 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:35 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b 1G" returned: 0 in 1.175s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:35 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b Jun 25 17:07:35 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:35 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b" returned: 0 in 0.860s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:35 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b is being set with open permissions: ugo+rw: NotImplementedError Jun 25 17:07:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:36 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b Jun 25 17:07:36 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:36 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b" returned: 0 in 0.759s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:36 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.info Jun 25 17:07:36 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:37 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.info" returned: 0 in 0.775s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:37 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.info is being set with open permissions: ugo+rw: NotImplementedError Jun 25 17:07:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:37 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.info Jun 25 17:07:37 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:38 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.info" returned: 0 in 0.900s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.845s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:07:38 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-d7499923-ee53-41ec-94b9-58d2c280e751 tempest-GroupSnapshotsV319Test-770630235 None] group_snapshot 76b9f6f3-4034-48a2-8439-3e802d6bfaaa: created successfully Jun 25 17:07:39 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] group_snapshot 76b9f6f3-4034-48a2-8439-3e802d6bfaaa: deleting Jun 25 17:07:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] group_snapshot 76b9f6f3-4034-48a2-8439-3e802d6bfaaa: deleting {{(pid=93869) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 25 17:07:39 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] Acquiring lock "cinder-quobyte-208d8d01-0563-4359-bbbc-e9b1381f2f9a" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:07:39 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] Lock "cinder-quobyte-208d8d01-0563-4359-bbbc-e9b1381f2f9a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:07:39 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] Acquiring lock "cinder-quobyte-65e912b1-f856-422e-b88e-e7aee9a0183b" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:07:39 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] Lock "cinder-quobyte-65e912b1-f856-422e-b88e-e7aee9a0183b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:07:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] Deleting offline snapshot 65e912b1-f856-422e-b88e-e7aee9a0183b of volume 208d8d01-0563-4359-bbbc-e9b1381f2f9a {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:07:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] snapshot_file for this snap is: volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:07:39 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00ff65e-f74c-4681-858c-305ca13fe0d1]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:07:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:40 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b Jun 25 17:07:40 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:41 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b" returned: 0 in 1.123s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:07:41 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dbcace-f990-49d8-9af5-b0d68336c8a3]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:07:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:41 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a Jun 25 17:07:41 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:42 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a" returned: 0 in 0.856s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:42 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b Jun 25 17:07:42 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:43 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b" returned: 0 in 1.182s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:43 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b Jun 25 17:07:43 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:07:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:07:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:07:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:07:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:07:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:07:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:44 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:07:44 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:44 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a.65e912b1-f856-422e-b88e-e7aee9a0183b" returned: 0 in 1.258s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] Lock "cinder-quobyte-65e912b1-f856-422e-b88e-e7aee9a0183b" released by "_delete_snapshot" :: held 4.636s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:07:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] Lock "cinder-quobyte-208d8d01-0563-4359-bbbc-e9b1381f2f9a" released by "delete_snapshot" :: held 4.685s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:07:44 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=65,cinder:UPDATE=79,cinder:DELETE=4,cinder:INSERT=14 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:07:44 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=74,cinder:SELECT=71,cinder:INSERT=17,cinder:DELETE=4 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:07:44 devstack cinder-volume[93869]: WARNING cinder.quota [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1858165916 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1858165916, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:07:44 devstack cinder-volume[93869]: WARNING cinder.quota [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1858165916 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1858165916, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:07:44 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] Created reservations ['41910e09-0f30-4925-9f01-f79e7d457b70', 'bca9eddb-8f2d-468a-9a00-e9506515be63', '76d1c5c7-6a4b-4e1e-8c74-3cd1680407e5', '96284d59-70a2-4fac-82bc-28a16fbd00e7'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:07:44 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-d9938890-9db3-41d9-a15d-8416dd83926c tempest-GroupSnapshotsV319Test-770630235 None] group_snapshot 76b9f6f3-4034-48a2-8439-3e802d6bfaaa: deleted successfully Jun 25 17:07:45 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.684s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:07:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:07:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 8 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:07:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:07:46 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d7e18536-ab76-464a-9cd0-9c87c9a3a332 tempest-GroupSnapshotsV319Test-770630235 None] Acquiring lock "cinder-quobyte-208d8d01-0563-4359-bbbc-e9b1381f2f9a" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:07:46 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d7e18536-ab76-464a-9cd0-9c87c9a3a332 tempest-GroupSnapshotsV319Test-770630235 None] Lock "cinder-quobyte-208d8d01-0563-4359-bbbc-e9b1381f2f9a" acquired by "delete_volume" :: waited 0.037s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:07:46 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d953fd-8b61-4eec-a545-2a0ec0eec370]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:07:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d7e18536-ab76-464a-9cd0-9c87c9a3a332 tempest-GroupSnapshotsV319Test-770630235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:46 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a Jun 25 17:07:46 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:47 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d7e18536-ab76-464a-9cd0-9c87c9a3a332 tempest-GroupSnapshotsV319Test-770630235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a" returned: 0 in 1.219s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d7e18536-ab76-464a-9cd0-9c87c9a3a332 tempest-GroupSnapshotsV319Test-770630235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:47 devstack sudo[100261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a Jun 25 17:07:47 devstack sudo[100261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:48 devstack sudo[100261]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d7e18536-ab76-464a-9cd0-9c87c9a3a332 tempest-GroupSnapshotsV319Test-770630235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-208d8d01-0563-4359-bbbc-e9b1381f2f9a" returned: 0 in 0.976s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:48 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d7e18536-ab76-464a-9cd0-9c87c9a3a332 tempest-GroupSnapshotsV319Test-770630235 None] Lock "cinder-quobyte-208d8d01-0563-4359-bbbc-e9b1381f2f9a" released by "delete_volume" :: held 2.304s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:07:48 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-d7e18536-ab76-464a-9cd0-9c87c9a3a332 tempest-GroupSnapshotsV319Test-770630235 None] Created reservations ['abc41195-965e-4bf2-a11f-85d30cb6887e'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:07:48 devstack cinder-volume[93869]: WARNING cinder.quota [None req-d7e18536-ab76-464a-9cd0-9c87c9a3a332 tempest-GroupSnapshotsV319Test-770630235 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1858165916 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1858165916, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:07:48 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-d7e18536-ab76-464a-9cd0-9c87c9a3a332 tempest-GroupSnapshotsV319Test-770630235 None] Created reservations ['516a4d3f-facc-48ca-a7ae-c3da06fbd912', '15e6bb06-72f6-442b-b6d1-8ec5645f6066', '69394455-c8ce-45d6-bf4c-fed7890a35be', '849a09ac-8a82-4c61-af42-6021784fc4a7'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:07:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d7e18536-ab76-464a-9cd0-9c87c9a3a332 tempest-GroupSnapshotsV319Test-770630235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:07:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d7e18536-ab76-464a-9cd0-9c87c9a3a332 tempest-GroupSnapshotsV319Test-770630235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:07:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d7e18536-ab76-464a-9cd0-9c87c9a3a332 tempest-GroupSnapshotsV319Test-770630235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:07:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d7e18536-ab76-464a-9cd0-9c87c9a3a332 tempest-GroupSnapshotsV319Test-770630235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:07:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d7e18536-ab76-464a-9cd0-9c87c9a3a332 tempest-GroupSnapshotsV319Test-770630235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:07:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d7e18536-ab76-464a-9cd0-9c87c9a3a332 tempest-GroupSnapshotsV319Test-770630235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:07:48 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:07:48 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:07:50 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Jun 25 17:07:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d7e18536-ab76-464a-9cd0-9c87c9a3a332 tempest-GroupSnapshotsV319Test-770630235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.409s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:07:50 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-d7e18536-ab76-464a-9cd0-9c87c9a3a332 tempest-GroupSnapshotsV319Test-770630235 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:07:50 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-d7e18536-ab76-464a-9cd0-9c87c9a3a332 tempest-GroupSnapshotsV319Test-770630235 None] Delete group completed successfully. Jun 25 17:07:58 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=12,cinder:INSERT=5,cinder:UPDATE=17 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:07:58 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=14,cinder:INSERT=4,cinder:UPDATE=16 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:08:00 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-a2b61424-d238-4304-95d9-26797237d004 req-9e636dea-f328-4f79-8798-95627dfc6328 tempest-AttachVolumeTestJSON-641953485 None] Terminate volume connection completed successfully. Jun 25 17:08:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-a2b61424-d238-4304-95d9-26797237d004 req-9e636dea-f328-4f79-8798-95627dfc6328 tempest-AttachVolumeTestJSON-641953485 None] Deleting attachment 796fa176-c7f8-4973-88be-ac5a77f4d5e1. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:08:03 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-58f8647d-345d-40bf-85e4-6a3d6f93c52f tempest-GroupsV314Test-1513725726 None] Group tempest-GroupsV314Test-Group-46963246: creating Jun 25 17:08:03 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-58f8647d-345d-40bf-85e4-6a3d6f93c52f tempest-GroupsV314Test-1513725726 None] Group tempest-GroupsV314Test-Group-46963246: created successfully Jun 25 17:08:03 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-58f8647d-345d-40bf-85e4-6a3d6f93c52f tempest-GroupsV314Test-1513725726 None] Create group completed successfully. Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Flow 'volume_create_manager' (e217f799-9104-4604-8611-99029b736fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9eadf68-f0a8-45ad-8d44-3245cc6fb2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9eadf68-f0a8-45ad-8d44-3245cc6fb2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-739605888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7aa4e5f8-9f9a-48b3-84c8-d9cb687f7c21,host='devstack@QuobyteHD#QuobyteHD',id=2b2e62a8-7597-41f9-ac05-ca4b9f35bca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293e235a37f24b2b92e2eda1af25f3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:08:06Z,use_quota=True,user_id='cc87c989a63646288d667aa408200dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac201d3-d00b-4b85-a183-86ade7409f3e),volume_type_id=9ac201d3-d00b-4b85-a183-86ade7409f3e)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a31471-74cf-4d2c-94e7-1bc6cc9af908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a31471-74cf-4d2c-94e7-1bc6cc9af908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbb68f5-b6f8-448e-aa42-67ff97a09448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbb68f5-b6f8-448e-aa42-67ff97a09448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b2e62a8-7597-41f9-ac05-ca4b9f35bca8', 'volume_name': 'volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1e440c-c2b6-4a18-8111-a518cccb394a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d1e440c-c2b6-4a18-8111-a518cccb394a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b18b3d2-a7da-4dbc-96fb-0412c8cb820a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:08:05 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Volume 2b2e62a8-7597-41f9-ac05-ca4b9f35bca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8', 'volume_size': 1} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7aa4e5f8-9f9a-48b3-84c8-d9cb687f7c21,created_at=2026-06-25T15:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-739605888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7aa4e5f8-9f9a-48b3-84c8-d9cb687f7c21,host='devstack@QuobyteHD#QuobyteHD',id=2b2e62a8-7597-41f9-ac05-ca4b9f35bca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293e235a37f24b2b92e2eda1af25f3b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:08:06Z,use_quota=True,user_id='cc87c989a63646288d667aa408200dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ac201d3-d00b-4b85-a183-86ade7409f3e),volume_type_id=9ac201d3-d00b-4b85-a183-86ade7409f3e)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Creating volume 2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:08:05 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:08:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:05 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 1073741824 Jun 25 17:08:05 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:06 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:08:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Flow 'volume_create_manager' (7d2ccc6e-5d5c-42e0-b696-c230e47b3d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:08:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99053124-6a9c-4808-8af9-44ed4ba8ae16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:08:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99053124-6a9c-4808-8af9-44ed4ba8ae16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1969412715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed13a3b5497417881f23a499440bf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:08:07Z,use_quota=True,user_id='bec3a8704d3643718203ae1439137314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:08:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476534a7-b1a8-406b-8278-144a9098d7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:08:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476534a7-b1a8-406b-8278-144a9098d7e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:08:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80008860-38e6-444a-8d71-561564735668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:08:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80008860-38e6-444a-8d71-561564735668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99', 'volume_name': 'volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:08:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234bc01a-c7c3-4001-9c96-0b94569c114b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:08:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234bc01a-c7c3-4001-9c96-0b94569c114b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:08:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1cb50a-6813-4271-a9c8-47b9f231350c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:08:06 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Volume 5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99', 'volume_size': 1} Jun 25 17:08:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:08:07 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 1073741824" returned: 0 in 1.156s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:07 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 Jun 25 17:08:07 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:07 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8" returned: 0 in 0.681s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:08:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:08:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.903s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:08:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1969412715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed13a3b5497417881f23a499440bf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:08:07Z,use_quota=True,user_id='bec3a8704d3643718203ae1439137314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:08:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Creating volume 5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:08:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:08:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:08:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:08:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:08:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:08:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:08:07 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:08:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:07 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99 1073741824 Jun 25 17:08:07 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b18b3d2-a7da-4dbc-96fb-0412c8cb820a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:08:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd0923c-440c-4c23-8668-93ccb198797e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:08:07 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Volume volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 (2b2e62a8-7597-41f9-ac05-ca4b9f35bca8): created successfully Jun 25 17:08:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbd0923c-440c-4c23-8668-93ccb198797e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:08:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Flow 'volume_create_manager' (e217f799-9104-4604-8611-99029b736fda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:08:07 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-4961edb4-af9c-4471-b017-187ce9e79caf tempest-GroupsV314Test-1513725726 None] Created volume successfully. Jun 25 17:08:08 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99 1073741824" returned: 0 in 0.944s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:08 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99 Jun 25 17:08:08 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:09 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99" returned: 0 in 0.810s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:08:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:08:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1cb50a-6813-4271-a9c8-47b9f231350c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:08:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b2e6d1c-d244-4497-a9d5-a3e70ca24676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:08:09 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Volume volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99 (5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99): created successfully Jun 25 17:08:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b2e6d1c-d244-4497-a9d5-a3e70ca24676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:08:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Flow 'volume_create_manager' (7d2ccc6e-5d5c-42e0-b696-c230e47b3d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:08:09 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-dbb1965a-52bc-443c-b1a5-1a1e01dd4a3a tempest-AttachVolumeNegativeTest-109492441 None] Created volume successfully. Jun 25 17:08:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:08:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:08:09 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Cloning volume 2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 to volume 4e765042-2164-4367-8573-ddb59137287a Jun 25 17:08:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Creating offline snapshot c978a9dc-2979-403e-b1f7-1aceebdfe18a of volume 2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:08:09 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[274fa69e-c8f7-4fe2-81bd-734045e6628d]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:08:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:09 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 Jun 25 17:08:09 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:10 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8" returned: 0 in 1.007s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:10 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a 1G Jun 25 17:08:10 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:12 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a 1G" returned: 0 in 1.309s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:12 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a Jun 25 17:08:12 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:13 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a" returned: 0 in 1.231s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:13 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a is being set with open permissions: ugo+rw: NotImplementedError Jun 25 17:08:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:13 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a Jun 25 17:08:13 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-cf2e707a-7249-445f-ba61-b7c58030d9ef req-08d441ba-981b-4232-817d-af05c7b968ce tempest-AttachVolumeNegativeTest-109492441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:08:14 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a" returned: 0 in 1.116s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:14 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.info Jun 25 17:08:14 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:15 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.info" returned: 0 in 1.004s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:15 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.info is being set with open permissions: ugo+rw: NotImplementedError Jun 25 17:08:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:15 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.info Jun 25 17:08:15 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:16 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.info" returned: 0 in 0.869s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:16 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Acquiring lock "cinder-quobyte-4e765042-2164-4367-8573-ddb59137287a" by "_copy_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:08:16 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Lock "cinder-quobyte-4e765042-2164-4367-8573-ddb59137287a" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:08:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] snapshot: c978a9dc-2979-403e-b1f7-1aceebdfe18a, volume: 4e765042-2164-4367-8573-ddb59137287a, {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 17:08:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:08:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:08:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:08:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:08:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:08:16 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e6c495-5a26-49e5-a66f-806e6622384c]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:08:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:16 devstack sudo[100383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a Jun 25 17:08:16 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:17 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a" returned: 0 in 0.869s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:08:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] will copy from snapshot at /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 17:08:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Creating direct copy from snapshot {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 17:08:17 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b547d73-b404-4bdc-94ca-c2bb821b1ad2]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:08:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:17 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 Jun 25 17:08:17 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:18 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8" returned: 0 in 0.875s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:18 devstack cinder-volume[93869]: DEBUG cinder.utils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Path /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4e765042-2164-4367-8573-ddb59137287a not found in is_blk_device check {{(pid=93869) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 17:08:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4e765042-2164-4367-8573-ddb59137287a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:18 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4e765042-2164-4367-8573-ddb59137287a Jun 25 17:08:18 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:24 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=15,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:08:24 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=11,cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=2 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:08:27 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4e765042-2164-4367-8573-ddb59137287a" returned: 0 in 9.052s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:27 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[82517b85-1d5f-40ff-af29-d8f81a2335a3]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:08:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:27 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 Jun 25 17:08:27 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:29 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:08:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Flow 'volume_create_manager' (641c6c05-8f5a-4229-b093-08ac674e6c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:08:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1bb8397-8a62-41b3-88f0-170d723a585d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:08:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1bb8397-8a62-41b3-88f0-170d723a585d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1418934772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f75b1a9-71c0-4293-9e09-4b00a45b3cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecaf945757a648f5a4c8dbd5d6b3a1d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:08:29Z,use_quota=True,user_id='4f76bff00d3f406fbf7817132b13fc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:08:29 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a00b24-0716-4b79-85ea-3222d45cfef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:08:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a00b24-0716-4b79-85ea-3222d45cfef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:08:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb96f930-2009-4084-b3df-75286a337e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:08:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb96f930-2009-4084-b3df-75286a337e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f75b1a9-71c0-4293-9e09-4b00a45b3cac', 'volume_name': 'volume-9f75b1a9-71c0-4293-9e09-4b00a45b3cac', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:08:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c39344-56f1-49a6-9b7b-ddd806f103d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:08:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6c39344-56f1-49a6-9b7b-ddd806f103d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:08:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93beda45-ee51-4d4b-8bd4-8ffd79b3a05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:08:29 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Volume 9f75b1a9-71c0-4293-9e09-4b00a45b3cac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f75b1a9-71c0-4293-9e09-4b00a45b3cac', 'volume_size': 1} Jun 25 17:08:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:08:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8" returned: 0 in 2.070s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:29 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Image conversion details: src /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8, size 1024.00 MB, duration 9.05 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4e765042-2164-4367-8573-ddb59137287a {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:08:29 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Converted 1024.00 MB image at 113.10 MB/s Jun 25 17:08:29 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4e765042-2164-4367-8573-ddb59137287a is being set with open permissions: ugo+rw: NotImplementedError Jun 25 17:08:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4e765042-2164-4367-8573-ddb59137287a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:29 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4e765042-2164-4367-8573-ddb59137287a Jun 25 17:08:29 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:30 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4e765042-2164-4367-8573-ddb59137287a" returned: 0 in 0.725s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:30 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Lock "cinder-quobyte-4e765042-2164-4367-8573-ddb59137287a" released by "_copy_volume_from_snapshot" :: held 13.769s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:08:30 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Acquiring lock "cinder-quobyte-c978a9dc-2979-403e-b1f7-1aceebdfe18a" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:08:30 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Lock "cinder-quobyte-c978a9dc-2979-403e-b1f7-1aceebdfe18a" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:08:30 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Deleting offline snapshot c978a9dc-2979-403e-b1f7-1aceebdfe18a of volume 2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:08:30 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] snapshot_file for this snap is: volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:08:30 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f582c0a8-adbc-4460-9a17-a59e698a9c20]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:08:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:30 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a Jun 25 17:08:30 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:31 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a" returned: 0 in 0.893s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:08:31 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bd9e84-a9d0-4f97-92f4-0d8415f2d03f]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:08:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:31 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 Jun 25 17:08:31 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:32 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8" returned: 0 in 1.188s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:32 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a Jun 25 17:08:32 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:33 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a" returned: 0 in 1.230s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:33 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a Jun 25 17:08:33 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:34 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8.c978a9dc-2979-403e-b1f7-1aceebdfe18a" returned: 0 in 0.772s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:34 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Lock "cinder-quobyte-c978a9dc-2979-403e-b1f7-1aceebdfe18a" released by "_delete_snapshot" :: held 4.285s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:08:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 25.036s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:08:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-cf2e707a-7249-445f-ba61-b7c58030d9ef req-08d441ba-981b-4232-817d-af05c7b968ce tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 20.512s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:08:34 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce183bb4-a53a-469e-a077-51aa193eca62]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:08:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-cf2e707a-7249-445f-ba61-b7c58030d9ef req-08d441ba-981b-4232-817d-af05c7b968ce tempest-AttachVolumeNegativeTest-109492441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:34 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-8d24d2b0-affc-4f33-a413-8b11fd9fd103 tempest-GroupsV314Test-1513725726 None] Create group from source-group-7aa4e5f8-9f9a-48b3-84c8-d9cb687f7c21 completed successfully. Jun 25 17:08:34 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99 Jun 25 17:08:34 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:36 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-cf2e707a-7249-445f-ba61-b7c58030d9ef req-08d441ba-981b-4232-817d-af05c7b968ce tempest-AttachVolumeNegativeTest-109492441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99" returned: 0 in 1.311s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-cf2e707a-7249-445f-ba61-b7c58030d9ef req-08d441ba-981b-4232-817d-af05c7b968ce tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.341s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:08:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.643s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:08:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1418934772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f75b1a9-71c0-4293-9e09-4b00a45b3cac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecaf945757a648f5a4c8dbd5d6b3a1d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:08:29Z,use_quota=True,user_id='4f76bff00d3f406fbf7817132b13fc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:08:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Creating volume 9f75b1a9-71c0-4293-9e09-4b00a45b3cac {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:08:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:08:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:08:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:08:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:08:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:08:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:08:36 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:08:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9f75b1a9-71c0-4293-9e09-4b00a45b3cac 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:36 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9f75b1a9-71c0-4293-9e09-4b00a45b3cac 1073741824 Jun 25 17:08:36 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:36 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] Acquiring lock "cinder-quobyte-4e765042-2164-4367-8573-ddb59137287a" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:08:36 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] Lock "cinder-quobyte-4e765042-2164-4367-8573-ddb59137287a" acquired by "delete_volume" :: waited 0.104s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:08:36 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-cf2e707a-7249-445f-ba61-b7c58030d9ef req-08d441ba-981b-4232-817d-af05c7b968ce tempest-AttachVolumeNegativeTest-109492441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d0f5798-cdf3-46b8-80b1-f15023891341', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:08:36 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea853977-77de-4efd-a6b9-7ca2da154279]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:08:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4e765042-2164-4367-8573-ddb59137287a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:36 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-cf2e707a-7249-445f-ba61-b7c58030d9ef req-08d441ba-981b-4232-817d-af05c7b968ce tempest-AttachVolumeNegativeTest-109492441 None] attachment_update completed successfully. Jun 25 17:08:37 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4e765042-2164-4367-8573-ddb59137287a Jun 25 17:08:37 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:39 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4e765042-2164-4367-8573-ddb59137287a" returned: 0 in 2.544s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4e765042-2164-4367-8573-ddb59137287a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:39 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4e765042-2164-4367-8573-ddb59137287a Jun 25 17:08:39 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:39 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9f75b1a9-71c0-4293-9e09-4b00a45b3cac 1073741824" returned: 0 in 3.033s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9f75b1a9-71c0-4293-9e09-4b00a45b3cac {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:39 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9f75b1a9-71c0-4293-9e09-4b00a45b3cac Jun 25 17:08:39 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:40 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4e765042-2164-4367-8573-ddb59137287a" returned: 0 in 1.240s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:40 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] Lock "cinder-quobyte-4e765042-2164-4367-8573-ddb59137287a" released by "delete_volume" :: held 3.980s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:08:40 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] Created reservations ['d6cbeb83-41a8-4d5d-ad77-45cecb681a5d'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:08:40 devstack cinder-volume[93869]: WARNING cinder.quota [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1561109366 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1561109366, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:08:40 devstack cinder-volume[93869]: WARNING cinder.quota [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1561109366 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1561109366, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:08:40 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] Created reservations ['0192880d-a988-4a03-8643-35db8cf91664', '8d4f165b-7479-4fd5-85cc-857c1e77ad71', 'cc04fd49-cab1-4abd-b954-607650494819', 'f1bb3ce4-1517-4186-9bcf-25f1a4527b18'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:08:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:08:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:08:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:08:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:08:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:08:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:41 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9f75b1a9-71c0-4293-9e09-4b00a45b3cac" returned: 0 in 1.878s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] <== create_volume: return (5076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:08:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.083s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:08:41 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:08:41 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93beda45-ee51-4d4b-8bd4-8ffd79b3a05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f75b1a9-71c0-4293-9e09-4b00a45b3cac', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:08:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdaca24b-28cd-464b-b718-d5bcec3ca7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:08:41 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Volume volume-9f75b1a9-71c0-4293-9e09-4b00a45b3cac (9f75b1a9-71c0-4293-9e09-4b00a45b3cac): created successfully Jun 25 17:08:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdaca24b-28cd-464b-b718-d5bcec3ca7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:08:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Flow 'volume_create_manager' (641c6c05-8f5a-4229-b093-08ac674e6c31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:08:41 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-6184b889-36fe-419c-ae40-4db8deb25412 tempest-VolumesActionsTest-2001748675 None] Created volume successfully. Jun 25 17:08:41 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c161c6cc-54f4-45f1-aa5c-8a4bf2b560a8 tempest-VolumesActionsTest-2001748675 None] Acquiring lock "cinder-9f75b1a9-71c0-4293-9e09-4b00a45b3cac" by "attach_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:08:41 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c161c6cc-54f4-45f1-aa5c-8a4bf2b560a8 tempest-VolumesActionsTest-2001748675 None] Lock "cinder-9f75b1a9-71c0-4293-9e09-4b00a45b3cac" acquired by "attach_volume" :: waited 0.036s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:08:42 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-c161c6cc-54f4-45f1-aa5c-8a4bf2b560a8 tempest-VolumesActionsTest-2001748675 None] Attaching volume 9f75b1a9-71c0-4293-9e09-4b00a45b3cac to instance a9451c7f-261f-4eac-8163-f31e1e363ebf at mountpoint /dev/vdb on host None. Jun 25 17:08:42 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-c161c6cc-54f4-45f1-aa5c-8a4bf2b560a8 tempest-VolumesActionsTest-2001748675 None] Attach volume completed successfully. Jun 25 17:08:42 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c161c6cc-54f4-45f1-aa5c-8a4bf2b560a8 tempest-VolumesActionsTest-2001748675 None] Lock "cinder-9f75b1a9-71c0-4293-9e09-4b00a45b3cac" released by "attach_volume" :: held 0.252s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:08:42 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.728s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:42 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:08:42 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-bf0bffad-0488-4f86-8580-d53f598086cf tempest-GroupsV314Test-1513725726 None] Acquiring lock "cinder-quobyte-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:08:42 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-8e7f3298-ce69-436b-a509-590c781a0332 tempest-GroupsV314Test-1513725726 None] Delete group completed successfully. Jun 25 17:08:42 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-bf0bffad-0488-4f86-8580-d53f598086cf tempest-GroupsV314Test-1513725726 None] Lock "cinder-quobyte-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8" acquired by "delete_volume" :: waited 0.063s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:08:43 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd98e897-0a49-4cdf-a378-117d3f2334c8]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:08:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bf0bffad-0488-4f86-8580-d53f598086cf tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:43 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 Jun 25 17:08:43 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:43 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b29b498a-b0df-4448-a5c6-66595522543e tempest-VolumesActionsTest-747161382 None] Terminate volume connection completed successfully. Jun 25 17:08:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:08:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:08:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:08:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:08:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:08:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:08:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:44 devstack sudo[101112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:08:44 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b29b498a-b0df-4448-a5c6-66595522543e tempest-VolumesActionsTest-747161382 None] Acquiring lock "cinder-9f75b1a9-71c0-4293-9e09-4b00a45b3cac-detach_volume" by "detach_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:08:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b29b498a-b0df-4448-a5c6-66595522543e tempest-VolumesActionsTest-747161382 None] Lock "cinder-9f75b1a9-71c0-4293-9e09-4b00a45b3cac-detach_volume" acquired by "detach_volume" :: waited 0.059s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:08:44 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b29b498a-b0df-4448-a5c6-66595522543e tempest-VolumesActionsTest-747161382 None] Detaching volume 9f75b1a9-71c0-4293-9e09-4b00a45b3cac from instance a9451c7f-261f-4eac-8163-f31e1e363ebf. Jun 25 17:08:44 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b29b498a-b0df-4448-a5c6-66595522543e tempest-VolumesActionsTest-747161382 None] Detach volume completed successfully. Jun 25 17:08:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b29b498a-b0df-4448-a5c6-66595522543e tempest-VolumesActionsTest-747161382 None] Lock "cinder-9f75b1a9-71c0-4293-9e09-4b00a45b3cac-detach_volume" released by "detach_volume" :: held 0.258s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:08:44 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bf0bffad-0488-4f86-8580-d53f598086cf tempest-GroupsV314Test-1513725726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8" returned: 0 in 1.676s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bf0bffad-0488-4f86-8580-d53f598086cf tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:44 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8 Jun 25 17:08:44 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:45 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-26c49cb2-8149-4ca7-9bbc-1c0021dbb6e2 tempest-VolumesActionsTest-2001748675 None] Acquiring lock "cinder-9f75b1a9-71c0-4293-9e09-4b00a45b3cac-detach_volume" by "detach_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:08:45 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-26c49cb2-8149-4ca7-9bbc-1c0021dbb6e2 tempest-VolumesActionsTest-2001748675 None] Lock "cinder-9f75b1a9-71c0-4293-9e09-4b00a45b3cac-detach_volume" acquired by "detach_volume" :: waited 0.091s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:08:45 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-26c49cb2-8149-4ca7-9bbc-1c0021dbb6e2 tempest-VolumesActionsTest-2001748675 None] Volume detach called, but volume not attached. Jun 25 17:08:45 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-26c49cb2-8149-4ca7-9bbc-1c0021dbb6e2 tempest-VolumesActionsTest-2001748675 None] Lock "cinder-9f75b1a9-71c0-4293-9e09-4b00a45b3cac-detach_volume" released by "detach_volume" :: held 0.121s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:08:46 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bf0bffad-0488-4f86-8580-d53f598086cf tempest-GroupsV314Test-1513725726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8" returned: 0 in 1.495s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:46 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-bf0bffad-0488-4f86-8580-d53f598086cf tempest-GroupsV314Test-1513725726 None] Lock "cinder-quobyte-2b2e62a8-7597-41f9-ac05-ca4b9f35bca8" released by "delete_volume" :: held 3.467s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:08:46 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 2.489s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:46 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:08:46 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:08:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 8 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:08:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:08:46 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-bf0bffad-0488-4f86-8580-d53f598086cf tempest-GroupsV314Test-1513725726 None] Created reservations ['ac3aa27a-862b-4c30-933a-ceb90b758c00'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:08:46 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-bf0bffad-0488-4f86-8580-d53f598086cf tempest-GroupsV314Test-1513725726 None] Created reservations ['1057fb73-ae9d-4799-aa49-96ed774cedbd', '7196d097-7fe8-4e0e-8b6b-37b016eb3c91', '44ccf16e-e014-49e1-8ded-365b3479f62f', '61cafe64-cf09-4dd6-a520-8e4e40bda172'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:08:47 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] Acquiring lock "cinder-9f75b1a9-71c0-4293-9e09-4b00a45b3cac-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:08:47 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] Lock "cinder-9f75b1a9-71c0-4293-9e09-4b00a45b3cac-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:08:47 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] Acquiring lock "cinder-quobyte-9f75b1a9-71c0-4293-9e09-4b00a45b3cac" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:08:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bf0bffad-0488-4f86-8580-d53f598086cf tempest-GroupsV314Test-1513725726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:08:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bf0bffad-0488-4f86-8580-d53f598086cf tempest-GroupsV314Test-1513725726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:08:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bf0bffad-0488-4f86-8580-d53f598086cf tempest-GroupsV314Test-1513725726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:08:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bf0bffad-0488-4f86-8580-d53f598086cf tempest-GroupsV314Test-1513725726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:08:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bf0bffad-0488-4f86-8580-d53f598086cf tempest-GroupsV314Test-1513725726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:08:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bf0bffad-0488-4f86-8580-d53f598086cf tempest-GroupsV314Test-1513725726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:47 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] Lock "cinder-quobyte-9f75b1a9-71c0-4293-9e09-4b00a45b3cac" acquired by "delete_volume" :: waited 0.100s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:08:47 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:08:47 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:47 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1de2a0-98a4-4cf1-ab7e-abc642e7b4ed]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:08:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9f75b1a9-71c0-4293-9e09-4b00a45b3cac {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:48 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9f75b1a9-71c0-4293-9e09-4b00a45b3cac Jun 25 17:08:48 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:49 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bf0bffad-0488-4f86-8580-d53f598086cf tempest-GroupsV314Test-1513725726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 2.159s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:49 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-bf0bffad-0488-4f86-8580-d53f598086cf tempest-GroupsV314Test-1513725726 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:08:49 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-bf0bffad-0488-4f86-8580-d53f598086cf tempest-GroupsV314Test-1513725726 None] Delete group completed successfully. Jun 25 17:08:50 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9f75b1a9-71c0-4293-9e09-4b00a45b3cac" returned: 0 in 2.335s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9f75b1a9-71c0-4293-9e09-4b00a45b3cac {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:50 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9f75b1a9-71c0-4293-9e09-4b00a45b3cac Jun 25 17:08:50 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:51 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9f75b1a9-71c0-4293-9e09-4b00a45b3cac" returned: 0 in 1.574s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:51 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] Lock "cinder-quobyte-9f75b1a9-71c0-4293-9e09-4b00a45b3cac" released by "delete_volume" :: held 4.090s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:08:51 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] Created reservations ['862387ec-fd58-4eb3-a3a9-a4d67e443822', '8ad7e04b-1522-4ef4-a52e-1908aed29aa8', '150a4778-4646-4532-8a51-1240c043677f', 'f6af577d-80a4-4004-9bc0-7c7d6b4961b7'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:08:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:08:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:08:51 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:08:51 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:08:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:08:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:08:52 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:08:52 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:08:53 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Jun 25 17:08:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.858s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:08:53 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:08:53 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] Deleted volume successfully. Jun 25 17:08:53 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a21b5afe-6300-48a5-9aa6-d1a068cec1e9 tempest-VolumesActionsTest-2001748675 None] Lock "cinder-9f75b1a9-71c0-4293-9e09-4b00a45b3cac-delete_volume" released by "delete_volume" :: held 6.602s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:09:01 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:09:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Flow 'volume_create_manager' (7399da0d-caa7-414e-adff-1b8f44bda56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfebc9e2-2e38-4c88-81f6-5d5c0b04321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfebc9e2-2e38-4c88-81f6-5d5c0b04321a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1502338705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602f7f75-8592-437e-9a81-616958969783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecaf945757a648f5a4c8dbd5d6b3a1d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:02Z,use_quota=True,user_id='4f76bff00d3f406fbf7817132b13fc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360cdcff-98b2-44ed-9136-1d12949ce041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360cdcff-98b2-44ed-9136-1d12949ce041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (793d8aec-fe85-49eb-affb-ef8e55403d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (793d8aec-fe85-49eb-affb-ef8e55403d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '602f7f75-8592-437e-9a81-616958969783', 'volume_name': 'volume-602f7f75-8592-437e-9a81-616958969783', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b953e1-bd23-4d5d-9cbc-a8f8d23ecb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93b953e1-bd23-4d5d-9cbc-a8f8d23ecb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec58483-ac61-4ad2-99a4-6fb0ac70ce18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:02 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Volume 602f7f75-8592-437e-9a81-616958969783: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-602f7f75-8592-437e-9a81-616958969783', 'volume_size': 1} Jun 25 17:09:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1502338705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602f7f75-8592-437e-9a81-616958969783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecaf945757a648f5a4c8dbd5d6b3a1d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:02Z,use_quota=True,user_id='4f76bff00d3f406fbf7817132b13fc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:09:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Creating volume 602f7f75-8592-437e-9a81-616958969783 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:09:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:09:02 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:09:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-602f7f75-8592-437e-9a81-616958969783 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:02 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-602f7f75-8592-437e-9a81-616958969783 1073741824 Jun 25 17:09:02 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:03 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-602f7f75-8592-437e-9a81-616958969783 1073741824" returned: 0 in 1.577s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-602f7f75-8592-437e-9a81-616958969783 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:03 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-602f7f75-8592-437e-9a81-616958969783 Jun 25 17:09:03 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:04 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-602f7f75-8592-437e-9a81-616958969783" returned: 0 in 0.710s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] <== create_volume: return (2381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:09:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.386s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec58483-ac61-4ad2-99a4-6fb0ac70ce18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-602f7f75-8592-437e-9a81-616958969783', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1198c9-03d7-4d10-b446-d17f616e7c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:04 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Volume volume-602f7f75-8592-437e-9a81-616958969783 (602f7f75-8592-437e-9a81-616958969783): created successfully Jun 25 17:09:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c1198c9-03d7-4d10-b446-d17f616e7c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Flow 'volume_create_manager' (7399da0d-caa7-414e-adff-1b8f44bda56f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:04 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-c1b92a3f-289f-4b68-b904-7d6537b2a095 tempest-VolumesActionsTest-2001748675 None] Created volume successfully. Jun 25 17:09:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] Acquiring lock "cinder-602f7f75-8592-437e-9a81-616958969783-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:09:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] Lock "cinder-602f7f75-8592-437e-9a81-616958969783-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:09:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] Acquiring lock "cinder-quobyte-602f7f75-8592-437e-9a81-616958969783" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:09:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] Lock "cinder-quobyte-602f7f75-8592-437e-9a81-616958969783" acquired by "delete_volume" :: waited 0.019s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:09:05 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6509fced-8131-417e-92e5-636be59789f8]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:09:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-602f7f75-8592-437e-9a81-616958969783 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:05 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-602f7f75-8592-437e-9a81-616958969783 Jun 25 17:09:05 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:06 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-602f7f75-8592-437e-9a81-616958969783" returned: 0 in 1.063s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-602f7f75-8592-437e-9a81-616958969783 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:06 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-602f7f75-8592-437e-9a81-616958969783 Jun 25 17:09:06 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Flow 'volume_create_manager' (83a91732-66c8-47c1-8633-162dcdc8cf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b0ed2c-4412-456b-afe2-0713a3fd9fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b0ed2c-4412-456b-afe2-0713a3fd9fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-145471513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372ac2ee-d325-4cac-aa3c-a2983a389789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0dc1e4c4f5b4222a58b1e37ba3133bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:07Z,use_quota=True,user_id='041894bc90034266943e391cc4421b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779a9150-94f7-4e87-9c75-0cea3cd62d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (779a9150-94f7-4e87-9c75-0cea3cd62d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12cb5e13-fc54-4cf1-87a5-6a6b9300fbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12cb5e13-fc54-4cf1-87a5-6a6b9300fbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '372ac2ee-d325-4cac-aa3c-a2983a389789', 'volume_name': 'volume-372ac2ee-d325-4cac-aa3c-a2983a389789', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027721e7-cd02-4ffb-bba4-0248c8763f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027721e7-cd02-4ffb-bba4-0248c8763f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8106cb98-6828-4bd8-9595-82186c8bc875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:07 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Volume 372ac2ee-d325-4cac-aa3c-a2983a389789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-372ac2ee-d325-4cac-aa3c-a2983a389789', 'volume_size': 1} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-145471513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=372ac2ee-d325-4cac-aa3c-a2983a389789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0dc1e4c4f5b4222a58b1e37ba3133bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:07Z,use_quota=True,user_id='041894bc90034266943e391cc4421b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Creating volume 372ac2ee-d325-4cac-aa3c-a2983a389789 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:09:07 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-372ac2ee-d325-4cac-aa3c-a2983a389789 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:07 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-372ac2ee-d325-4cac-aa3c-a2983a389789 1073741824 Jun 25 17:09:07 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:07 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-602f7f75-8592-437e-9a81-616958969783" returned: 0 in 1.090s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] Lock "cinder-quobyte-602f7f75-8592-437e-9a81-616958969783" released by "delete_volume" :: held 2.228s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] Created reservations ['7e73d1dc-2513-4ade-a3b6-22142a23c469', 'aad4e80b-b08f-45f8-86bf-8ca620c9bf06', '5eb41005-9e64-497e-8ecf-69ce3e33ff44', '5691f690-8f01-4f17-a829-303d38dacc9c'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:08 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:09:08 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:09 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-372ac2ee-d325-4cac-aa3c-a2983a389789 1073741824" returned: 0 in 1.790s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:09 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.455s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:09 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:09:09 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] Deleted volume successfully. Jun 25 17:09:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-372ac2ee-d325-4cac-aa3c-a2983a389789 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-0fd6d1f8-3d76-40fe-a84a-44853fd67aa2 tempest-VolumesActionsTest-747161382 None] Lock "cinder-602f7f75-8592-437e-9a81-616958969783-delete_volume" released by "delete_volume" :: held 4.154s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:09:09 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-372ac2ee-d325-4cac-aa3c-a2983a389789 Jun 25 17:09:09 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:10 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:09:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Flow 'volume_create_manager' (206adc53-4920-47c0-8607-ef24a0245092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39355a16-c97b-41b3-9deb-d95a61236f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39355a16-c97b-41b3-9deb-d95a61236f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1391399585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f37665e-e2eb-4f09-9a2c-26618de90ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecaf945757a648f5a4c8dbd5d6b3a1d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:10Z,use_quota=True,user_id='4f76bff00d3f406fbf7817132b13fc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9c5ac8-4295-430c-81f1-91ec2fefdb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9c5ac8-4295-430c-81f1-91ec2fefdb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9214e91c-be95-4795-8928-3e6766ef6e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9214e91c-be95-4795-8928-3e6766ef6e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f37665e-e2eb-4f09-9a2c-26618de90ff6', 'volume_name': 'volume-3f37665e-e2eb-4f09-9a2c-26618de90ff6', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81cf1fee-adba-457e-abf9-a5263f8c8a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81cf1fee-adba-457e-abf9-a5263f8c8a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c046519e-0cb3-4e6c-aeca-90088b2ea4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:10 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Volume 3f37665e-e2eb-4f09-9a2c-26618de90ff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f37665e-e2eb-4f09-9a2c-26618de90ff6', 'volume_size': 1} Jun 25 17:09:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:11 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-372ac2ee-d325-4cac-aa3c-a2983a389789" returned: 0 in 1.537s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:11 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] <== create_volume: return (3507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:09:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.510s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.382s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:11 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1391399585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f37665e-e2eb-4f09-9a2c-26618de90ff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecaf945757a648f5a4c8dbd5d6b3a1d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:10Z,use_quota=True,user_id='4f76bff00d3f406fbf7817132b13fc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:09:11 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Creating volume 3f37665e-e2eb-4f09-9a2c-26618de90ff6 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:09:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:11 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:11 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:11 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:09:11 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:09:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f37665e-e2eb-4f09-9a2c-26618de90ff6 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:11 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f37665e-e2eb-4f09-9a2c-26618de90ff6 1073741824 Jun 25 17:09:11 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:11 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8106cb98-6828-4bd8-9595-82186c8bc875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-372ac2ee-d325-4cac-aa3c-a2983a389789', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:11 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b839b8-3231-4921-9dcf-dee87c84e5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:11 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Volume volume-372ac2ee-d325-4cac-aa3c-a2983a389789 (372ac2ee-d325-4cac-aa3c-a2983a389789): created successfully Jun 25 17:09:11 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b839b8-3231-4921-9dcf-dee87c84e5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:11 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Flow 'volume_create_manager' (83a91732-66c8-47c1-8633-162dcdc8cf99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:11 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-e04d738a-d40b-4d8f-a879-76bfb0f5c8fa tempest-AttachVolumeTestJSON-641953485 None] Created volume successfully. Jun 25 17:09:13 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f37665e-e2eb-4f09-9a2c-26618de90ff6 1073741824" returned: 0 in 2.183s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f37665e-e2eb-4f09-9a2c-26618de90ff6 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:13 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f37665e-e2eb-4f09-9a2c-26618de90ff6 Jun 25 17:09:13 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:14 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f37665e-e2eb-4f09-9a2c-26618de90ff6" returned: 0 in 1.177s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] <== create_volume: return (3472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:09:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.482s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c046519e-0cb3-4e6c-aeca-90088b2ea4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f37665e-e2eb-4f09-9a2c-26618de90ff6', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5576d8-85c0-44d4-8900-7e4314cdd5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:14 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Volume volume-3f37665e-e2eb-4f09-9a2c-26618de90ff6 (3f37665e-e2eb-4f09-9a2c-26618de90ff6): created successfully Jun 25 17:09:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5576d8-85c0-44d4-8900-7e4314cdd5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Flow 'volume_create_manager' (206adc53-4920-47c0-8607-ef24a0245092) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:14 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-4de61fd4-f3f5-4ee5-9486-0f6ff5d38adb tempest-VolumesActionsTest-2001748675 None] Created volume successfully. Jun 25 17:09:15 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] Acquiring lock "cinder-3f37665e-e2eb-4f09-9a2c-26618de90ff6-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:09:15 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] Lock "cinder-3f37665e-e2eb-4f09-9a2c-26618de90ff6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:09:15 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] Acquiring lock "cinder-quobyte-3f37665e-e2eb-4f09-9a2c-26618de90ff6" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:09:15 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] Lock "cinder-quobyte-3f37665e-e2eb-4f09-9a2c-26618de90ff6" acquired by "delete_volume" :: waited 0.022s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:09:15 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d729ffed-65c5-4c55-94bb-323f72109167]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:09:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f37665e-e2eb-4f09-9a2c-26618de90ff6 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:16 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f37665e-e2eb-4f09-9a2c-26618de90ff6 Jun 25 17:09:16 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-a670e576-66fd-40ba-a437-526cc54af3b9 req-5788befb-727e-4322-845e-eef2902348f8 tempest-AttachVolumeTestJSON-641953485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-a670e576-66fd-40ba-a437-526cc54af3b9 req-5788befb-727e-4322-845e-eef2902348f8 tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:16 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46e4feb-471e-4baf-a39c-41e6eb677c2a]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:09:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-a670e576-66fd-40ba-a437-526cc54af3b9 req-5788befb-727e-4322-845e-eef2902348f8 tempest-AttachVolumeTestJSON-641953485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-372ac2ee-d325-4cac-aa3c-a2983a389789 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:16 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-372ac2ee-d325-4cac-aa3c-a2983a389789 Jun 25 17:09:16 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:17 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f37665e-e2eb-4f09-9a2c-26618de90ff6" returned: 0 in 1.499s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f37665e-e2eb-4f09-9a2c-26618de90ff6 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:17 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f37665e-e2eb-4f09-9a2c-26618de90ff6 Jun 25 17:09:17 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:17 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-a670e576-66fd-40ba-a437-526cc54af3b9 req-5788befb-727e-4322-845e-eef2902348f8 tempest-AttachVolumeTestJSON-641953485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-372ac2ee-d325-4cac-aa3c-a2983a389789" returned: 0 in 1.607s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-a670e576-66fd-40ba-a437-526cc54af3b9 req-5788befb-727e-4322-845e-eef2902348f8 tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.640s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:18 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-a670e576-66fd-40ba-a437-526cc54af3b9 req-5788befb-727e-4322-845e-eef2902348f8 tempest-AttachVolumeTestJSON-641953485 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-372ac2ee-d325-4cac-aa3c-a2983a389789', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f3240584-a30f-486b-b225-863f3382c11f', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:09:18 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-a670e576-66fd-40ba-a437-526cc54af3b9 req-5788befb-727e-4322-845e-eef2902348f8 tempest-AttachVolumeTestJSON-641953485 None] attachment_update completed successfully. Jun 25 17:09:18 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f37665e-e2eb-4f09-9a2c-26618de90ff6" returned: 0 in 1.154s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:18 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] Lock "cinder-quobyte-3f37665e-e2eb-4f09-9a2c-26618de90ff6" released by "delete_volume" :: held 2.741s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:09:18 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] Created reservations ['89204a44-2f1e-45d0-a314-46409004a866', '71e1d8f3-5dcf-47b1-a95c-68020eaf8665', '3b7e2dad-c119-4ab8-a5ff-aa3a7fcc81ec', '05b7ac50-b260-43fb-bd9d-1c6af3124356'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:09:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:18 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:18 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:18 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:09:18 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:20 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.363s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:09:20 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] Deleted volume successfully. Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d9108330-beb2-4526-aa20-d30955564318 tempest-VolumesActionsTest-747161382 None] Lock "cinder-3f37665e-e2eb-4f09-9a2c-26618de90ff6-delete_volume" released by "delete_volume" :: held 4.440s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Flow 'volume_create_manager' (72f9c900-e8be-48d9-a3e0-3f06c1121828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5ab1a5-c704-44e4-b8d0-24b430f81563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5ab1a5-c704-44e4-b8d0-24b430f81563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-530692615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd7e65af-efcc-4b9a-9e20-1b7a420c747a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecaf945757a648f5a4c8dbd5d6b3a1d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:20Z,use_quota=True,user_id='4f76bff00d3f406fbf7817132b13fc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f050cfad-d946-4704-a477-1c12369fc073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f050cfad-d946-4704-a477-1c12369fc073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2168293-72ac-4a35-94ee-f0779b4eb700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2168293-72ac-4a35-94ee-f0779b4eb700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd7e65af-efcc-4b9a-9e20-1b7a420c747a', 'volume_name': 'volume-fd7e65af-efcc-4b9a-9e20-1b7a420c747a', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f659e9-a878-4ffd-8f14-7a2281c86bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f659e9-a878-4ffd-8f14-7a2281c86bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f40478-dd15-41c4-a0ad-f0e62288d87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:20 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Volume fd7e65af-efcc-4b9a-9e20-1b7a420c747a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd7e65af-efcc-4b9a-9e20-1b7a420c747a', 'volume_size': 1} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-530692615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd7e65af-efcc-4b9a-9e20-1b7a420c747a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecaf945757a648f5a4c8dbd5d6b3a1d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:20Z,use_quota=True,user_id='4f76bff00d3f406fbf7817132b13fc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Creating volume fd7e65af-efcc-4b9a-9e20-1b7a420c747a {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:09:20 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:09:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fd7e65af-efcc-4b9a-9e20-1b7a420c747a 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:20 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fd7e65af-efcc-4b9a-9e20-1b7a420c747a 1073741824 Jun 25 17:09:20 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:21 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:09:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Flow 'volume_create_manager' (29d9a9ac-aa5c-4d72-be1a-c128415f3928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd49b533-5f24-4602-8b8b-8e30ea623b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd49b533-5f24-4602-8b8b-8e30ea623b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2089090988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91020831-cd50-4a51-ba8a-6defd7da354c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8e822d9d1d47ec9f8ed88642513329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:22Z,use_quota=True,user_id='8964e5334d1c481d9e142d6d780d134f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dba123d-394f-4d4d-aa4e-8bad18a2da88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:21 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dba123d-394f-4d4d-aa4e-8bad18a2da88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aebfad6-7576-428c-835f-10f28820fc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aebfad6-7576-428c-835f-10f28820fc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91020831-cd50-4a51-ba8a-6defd7da354c', 'volume_name': 'volume-91020831-cd50-4a51-ba8a-6defd7da354c', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012b9f7d-e9b6-4587-9b34-e5eb0061acca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (012b9f7d-e9b6-4587-9b34-e5eb0061acca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7b947c-e7c8-4d2f-bed7-f6ca492209b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:21 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Volume 91020831-cd50-4a51-ba8a-6defd7da354c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91020831-cd50-4a51-ba8a-6defd7da354c', 'volume_size': 1} Jun 25 17:09:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fd7e65af-efcc-4b9a-9e20-1b7a420c747a 1073741824" returned: 0 in 1.299s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fd7e65af-efcc-4b9a-9e20-1b7a420c747a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:21 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fd7e65af-efcc-4b9a-9e20-1b7a420c747a Jun 25 17:09:21 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:22 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fd7e65af-efcc-4b9a-9e20-1b7a420c747a" returned: 0 in 0.720s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:22 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] <== create_volume: return (2071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:09:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.768s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:22 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2089090988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91020831-cd50-4a51-ba8a-6defd7da354c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8e822d9d1d47ec9f8ed88642513329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:22Z,use_quota=True,user_id='8964e5334d1c481d9e142d6d780d134f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:09:22 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Creating volume 91020831-cd50-4a51-ba8a-6defd7da354c {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:09:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:22 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:22 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:22 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:09:22 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:09:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-91020831-cd50-4a51-ba8a-6defd7da354c 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:22 devstack sudo[101467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-91020831-cd50-4a51-ba8a-6defd7da354c 1073741824 Jun 25 17:09:22 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:22 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f40478-dd15-41c4-a0ad-f0e62288d87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd7e65af-efcc-4b9a-9e20-1b7a420c747a', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:22 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb82f98-2ffa-44eb-9e57-775b15860e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:22 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Volume volume-fd7e65af-efcc-4b9a-9e20-1b7a420c747a (fd7e65af-efcc-4b9a-9e20-1b7a420c747a): created successfully Jun 25 17:09:22 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb82f98-2ffa-44eb-9e57-775b15860e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:22 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Flow 'volume_create_manager' (72f9c900-e8be-48d9-a3e0-3f06c1121828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:22 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-9e2417c6-47ac-4a23-a415-a27e2c15c2b1 tempest-VolumesActionsTest-2001748675 None] Created volume successfully. Jun 25 17:09:23 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-91020831-cd50-4a51-ba8a-6defd7da354c 1073741824" returned: 0 in 1.027s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-91020831-cd50-4a51-ba8a-6defd7da354c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:23 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-91020831-cd50-4a51-ba8a-6defd7da354c Jun 25 17:09:23 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] Acquiring lock "cinder-fd7e65af-efcc-4b9a-9e20-1b7a420c747a-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:09:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] Lock "cinder-fd7e65af-efcc-4b9a-9e20-1b7a420c747a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:09:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] Acquiring lock "cinder-quobyte-fd7e65af-efcc-4b9a-9e20-1b7a420c747a" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:09:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] Lock "cinder-quobyte-fd7e65af-efcc-4b9a-9e20-1b7a420c747a" acquired by "delete_volume" :: waited 0.029s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7512ef25-e897-418b-9013-60969a554938]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fd7e65af-efcc-4b9a-9e20-1b7a420c747a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Flow 'volume_create_manager' (6fbf935e-96ec-4e9a-8a92-d2c46524f95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d78da396-5135-43e3-a469-1379fc7c25e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:24 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fd7e65af-efcc-4b9a-9e20-1b7a420c747a Jun 25 17:09:24 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d78da396-5135-43e3-a469-1379fc7c25e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1235329803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef146fcd-268c-4570-a80a-3793e038738f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0dc1e4c4f5b4222a58b1e37ba3133bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:24Z,use_quota=True,user_id='041894bc90034266943e391cc4421b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01c7992-fcc4-48aa-aa0d-8e0d01568063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01c7992-fcc4-48aa-aa0d-8e0d01568063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598207e5-c935-41ab-beaa-e324828f024d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598207e5-c935-41ab-beaa-e324828f024d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef146fcd-268c-4570-a80a-3793e038738f', 'volume_name': 'volume-ef146fcd-268c-4570-a80a-3793e038738f', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7a5df7-42ba-478f-9fdb-80d0ab1f94af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd7a5df7-42ba-478f-9fdb-80d0ab1f94af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a59a814-821f-4bf8-a009-3a7284f13679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:24 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Volume ef146fcd-268c-4570-a80a-3793e038738f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef146fcd-268c-4570-a80a-3793e038738f', 'volume_size': 1} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:24 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-91020831-cd50-4a51-ba8a-6defd7da354c" returned: 0 in 1.210s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] <== create_volume: return (2305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.310s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.639s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1235329803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef146fcd-268c-4570-a80a-3793e038738f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0dc1e4c4f5b4222a58b1e37ba3133bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:24Z,use_quota=True,user_id='041894bc90034266943e391cc4421b73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Creating volume ef146fcd-268c-4570-a80a-3793e038738f {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:09:24 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ef146fcd-268c-4570-a80a-3793e038738f 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:24 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=70,cinder:UPDATE=78,cinder:INSERT=15,cinder:DELETE=4 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:09:25 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ef146fcd-268c-4570-a80a-3793e038738f 1073741824 Jun 25 17:09:25 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7b947c-e7c8-4d2f-bed7-f6ca492209b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91020831-cd50-4a51-ba8a-6defd7da354c', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87ddcac-d840-48ac-8a3d-7bc34dabf7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:25 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=70,cinder:SELECT=60,cinder:INSERT=15,cinder:DELETE=4 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:09:25 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fd7e65af-efcc-4b9a-9e20-1b7a420c747a" returned: 0 in 0.995s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fd7e65af-efcc-4b9a-9e20-1b7a420c747a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:25 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Volume volume-91020831-cd50-4a51-ba8a-6defd7da354c (91020831-cd50-4a51-ba8a-6defd7da354c): created successfully Jun 25 17:09:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f87ddcac-d840-48ac-8a3d-7bc34dabf7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Flow 'volume_create_manager' (29d9a9ac-aa5c-4d72-be1a-c128415f3928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:25 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-c239483e-b0f8-4f56-b071-8320e1d9d4ac tempest-VolumeQuotasAdminTestJSON-842745007 None] Created volume successfully. Jun 25 17:09:25 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fd7e65af-efcc-4b9a-9e20-1b7a420c747a Jun 25 17:09:25 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:25 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fd7e65af-efcc-4b9a-9e20-1b7a420c747a" returned: 0 in 0.754s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] Lock "cinder-quobyte-fd7e65af-efcc-4b9a-9e20-1b7a420c747a" released by "delete_volume" :: held 1.803s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:09:25 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] Created reservations ['7577c50b-845e-42b7-9b41-2c3198c77953', '3a0998d6-e23e-4cc6-86aa-6e564d18b2ca', '41d11b8e-ee3f-4a9a-886d-de62a387ecbb', '668098ee-9830-4893-b314-2a3879d30236'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:09:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:25 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:09:25 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:26 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ef146fcd-268c-4570-a80a-3793e038738f 1073741824" returned: 0 in 1.125s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ef146fcd-268c-4570-a80a-3793e038738f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:26 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ef146fcd-268c-4570-a80a-3793e038738f Jun 25 17:09:26 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] Acquiring lock "cinder-91020831-cd50-4a51-ba8a-6defd7da354c-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:09:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] Lock "cinder-91020831-cd50-4a51-ba8a-6defd7da354c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:09:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] Acquiring lock "cinder-quobyte-91020831-cd50-4a51-ba8a-6defd7da354c" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:09:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] Lock "cinder-quobyte-91020831-cd50-4a51-ba8a-6defd7da354c" acquired by "delete_volume" :: waited 0.021s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:09:26 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2041790-2167-4ec1-965d-6514de5786d5]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:09:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-91020831-cd50-4a51-ba8a-6defd7da354c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:26 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-91020831-cd50-4a51-ba8a-6defd7da354c Jun 25 17:09:26 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:26 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.815s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:26 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:09:26 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] Deleted volume successfully. Jun 25 17:09:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-26eaf7a2-5191-49be-a76e-27027d450e39 tempest-VolumesActionsTest-747161382 None] Lock "cinder-fd7e65af-efcc-4b9a-9e20-1b7a420c747a-delete_volume" released by "delete_volume" :: held 2.906s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Flow 'volume_create_manager' (448d3a34-0e88-45c4-9f0c-895113629a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0411c6da-6bb9-4e59-b5fc-2004bd32f930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0411c6da-6bb9-4e59-b5fc-2004bd32f930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-948207736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082f915b-8426-4d2b-8c1b-3707d6aa44c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecaf945757a648f5a4c8dbd5d6b3a1d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:27Z,use_quota=True,user_id='4f76bff00d3f406fbf7817132b13fc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4e6d36-ca68-4a24-97b0-1b37f16138c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:27 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4e6d36-ca68-4a24-97b0-1b37f16138c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f21f7c-bab5-44f3-aec1-212dab77b265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f21f7c-bab5-44f3-aec1-212dab77b265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '082f915b-8426-4d2b-8c1b-3707d6aa44c4', 'volume_name': 'volume-082f915b-8426-4d2b-8c1b-3707d6aa44c4', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2430a713-d023-4faa-9b2d-3e6a0880fe41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2430a713-d023-4faa-9b2d-3e6a0880fe41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b9ab8e-3466-4cde-85f7-91daed4fd98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:27 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Volume 082f915b-8426-4d2b-8c1b-3707d6aa44c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-082f915b-8426-4d2b-8c1b-3707d6aa44c4', 'volume_size': 1} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ef146fcd-268c-4570-a80a-3793e038738f" returned: 0 in 1.009s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] <== create_volume: return (2188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.191s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-948207736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082f915b-8426-4d2b-8c1b-3707d6aa44c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecaf945757a648f5a4c8dbd5d6b3a1d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:27Z,use_quota=True,user_id='4f76bff00d3f406fbf7817132b13fc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Creating volume 082f915b-8426-4d2b-8c1b-3707d6aa44c4 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:09:27 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-082f915b-8426-4d2b-8c1b-3707d6aa44c4 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a59a814-821f-4bf8-a009-3a7284f13679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef146fcd-268c-4570-a80a-3793e038738f', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e9719f-24f5-4dec-8069-b4d32ec1e3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:27 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-082f915b-8426-4d2b-8c1b-3707d6aa44c4 1073741824 Jun 25 17:09:27 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:27 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Volume volume-ef146fcd-268c-4570-a80a-3793e038738f (ef146fcd-268c-4570-a80a-3793e038738f): created successfully Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e9719f-24f5-4dec-8069-b4d32ec1e3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Flow 'volume_create_manager' (6fbf935e-96ec-4e9a-8a92-d2c46524f95c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:27 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-d0c57e9e-60c9-4935-b298-9a4d1eea9f3f tempest-AttachVolumeTestJSON-641953485 None] Created volume successfully. Jun 25 17:09:27 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-91020831-cd50-4a51-ba8a-6defd7da354c" returned: 0 in 1.045s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-91020831-cd50-4a51-ba8a-6defd7da354c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:27 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-91020831-cd50-4a51-ba8a-6defd7da354c Jun 25 17:09:27 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:28 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-082f915b-8426-4d2b-8c1b-3707d6aa44c4 1073741824" returned: 0 in 0.942s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-082f915b-8426-4d2b-8c1b-3707d6aa44c4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:28 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-082f915b-8426-4d2b-8c1b-3707d6aa44c4 Jun 25 17:09:28 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:28 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-91020831-cd50-4a51-ba8a-6defd7da354c" returned: 0 in 0.780s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:28 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] Lock "cinder-quobyte-91020831-cd50-4a51-ba8a-6defd7da354c" released by "delete_volume" :: held 1.895s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:09:28 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] Created reservations ['49bbedc8-9941-44e9-8bdf-d1e100cb3a70', '7de1946e-786a-4455-8565-ce3d722ce963', 'b7fbde27-235a-456b-94db-db50649f7f43', 'ed72db1b-5f3a-4247-8d27-52f65903b1fa'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:09:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:28 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:09:28 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:28 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-082f915b-8426-4d2b-8c1b-3707d6aa44c4" returned: 0 in 0.773s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:09:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b9ab8e-3466-4cde-85f7-91daed4fd98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-082f915b-8426-4d2b-8c1b-3707d6aa44c4', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb71089-5547-4bbf-b51f-a7bf347236dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:28 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Volume volume-082f915b-8426-4d2b-8c1b-3707d6aa44c4 (082f915b-8426-4d2b-8c1b-3707d6aa44c4): created successfully Jun 25 17:09:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb71089-5547-4bbf-b51f-a7bf347236dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Flow 'volume_create_manager' (448d3a34-0e88-45c4-9f0c-895113629a87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:28 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-4e44218f-126f-4e54-a160-f0b3fc247387 tempest-VolumesActionsTest-2001748675 None] Created volume successfully. Jun 25 17:09:29 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.767s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:09:29 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] Deleted volume successfully. Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Flow 'volume_create_manager' (acb5cccb-d39a-428e-a031-c6b8796748df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7693b155-0f43-4366-af16-153503e44156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7693b155-0f43-4366-af16-153503e44156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1382526109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f021fec4-d8db-4705-bc57-de61be819541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8e822d9d1d47ec9f8ed88642513329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:29Z,use_quota=True,user_id='8964e5334d1c481d9e142d6d780d134f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce8c866-9874-4321-8632-47b59f4b7af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce8c866-9874-4321-8632-47b59f4b7af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc024d53-4c95-4c17-a228-bb9e81496b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc024d53-4c95-4c17-a228-bb9e81496b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f021fec4-d8db-4705-bc57-de61be819541', 'volume_name': 'volume-f021fec4-d8db-4705-bc57-de61be819541', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf910c67-35b7-43e3-9b9c-7ed603b04541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf910c67-35b7-43e3-9b9c-7ed603b04541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f750d72c-6692-42a8-9884-0b904602921d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:29 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Volume f021fec4-d8db-4705-bc57-de61be819541: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f021fec4-d8db-4705-bc57-de61be819541', 'volume_size': 1} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1382526109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f021fec4-d8db-4705-bc57-de61be819541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f8e822d9d1d47ec9f8ed88642513329',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:29Z,use_quota=True,user_id='8964e5334d1c481d9e142d6d780d134f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Creating volume f021fec4-d8db-4705-bc57-de61be819541 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:09:29 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f021fec4-d8db-4705-bc57-de61be819541 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fbd43483-792e-4cd0-82af-cf460c1713c3 tempest-VolumeQuotasAdminTestJSON-842745007 None] Lock "cinder-91020831-cd50-4a51-ba8a-6defd7da354c-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:09:29 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f021fec4-d8db-4705-bc57-de61be819541 1073741824 Jun 25 17:09:29 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] Acquiring lock "cinder-082f915b-8426-4d2b-8c1b-3707d6aa44c4-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] Lock "cinder-082f915b-8426-4d2b-8c1b-3707d6aa44c4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] Acquiring lock "cinder-quobyte-082f915b-8426-4d2b-8c1b-3707d6aa44c4" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] Lock "cinder-quobyte-082f915b-8426-4d2b-8c1b-3707d6aa44c4" acquired by "delete_volume" :: waited 0.015s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf957e5-12e8-4ed2-9aef-93629c928dcb]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:09:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-082f915b-8426-4d2b-8c1b-3707d6aa44c4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:29 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-082f915b-8426-4d2b-8c1b-3707d6aa44c4 Jun 25 17:09:29 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:30 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f021fec4-d8db-4705-bc57-de61be819541 1073741824" returned: 0 in 1.006s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f021fec4-d8db-4705-bc57-de61be819541 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:30 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f021fec4-d8db-4705-bc57-de61be819541 Jun 25 17:09:30 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:30 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-082f915b-8426-4d2b-8c1b-3707d6aa44c4" returned: 0 in 0.926s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-082f915b-8426-4d2b-8c1b-3707d6aa44c4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:30 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-082f915b-8426-4d2b-8c1b-3707d6aa44c4 Jun 25 17:09:30 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-cc2386c7-c6e0-456d-8d9e-1ac43473b942 req-26a736f0-26f1-4729-8f97-7515b1baa79a tempest-AttachVolumeTestJSON-641953485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f021fec4-d8db-4705-bc57-de61be819541" returned: 0 in 0.800s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:09:31 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-cc2386c7-c6e0-456d-8d9e-1ac43473b942 req-26a736f0-26f1-4729-8f97-7515b1baa79a tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.550s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:31 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-082f915b-8426-4d2b-8c1b-3707d6aa44c4" returned: 0 in 0.788s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f750d72c-6692-42a8-9884-0b904602921d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f021fec4-d8db-4705-bc57-de61be819541', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4096a334-abbe-4085-973d-7b8cdb79953e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:31 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b535e4-ff38-4b40-a07a-9e179e27ae4d]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:09:31 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] Lock "cinder-quobyte-082f915b-8426-4d2b-8c1b-3707d6aa44c4" released by "delete_volume" :: held 1.785s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:09:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-cc2386c7-c6e0-456d-8d9e-1ac43473b942 req-26a736f0-26f1-4729-8f97-7515b1baa79a tempest-AttachVolumeTestJSON-641953485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ef146fcd-268c-4570-a80a-3793e038738f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:31 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Volume volume-f021fec4-d8db-4705-bc57-de61be819541 (f021fec4-d8db-4705-bc57-de61be819541): created successfully Jun 25 17:09:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4096a334-abbe-4085-973d-7b8cdb79953e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Flow 'volume_create_manager' (acb5cccb-d39a-428e-a031-c6b8796748df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:31 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-396c5044-54ed-44eb-8d9c-0f8b70d557e6 tempest-VolumeQuotasAdminTestJSON-842745007 None] Created volume successfully. Jun 25 17:09:31 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] Created reservations ['1f227d00-7d2a-4b50-9214-d9871a99b5cd', 'a61ffe27-7e68-4724-a6cd-59b6f7ab0b29', '79ac56f6-9a5f-4dec-a0f1-7e40fe06cd51', 'c2c28aa8-239d-4883-baa2-556399d9d972'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:09:31 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ef146fcd-268c-4570-a80a-3793e038738f Jun 25 17:09:31 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:31 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:09:31 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:32 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.874s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:09:32 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] Deleted volume successfully. Jun 25 17:09:32 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Flow 'volume_create_manager' (8f2b4dc7-6008-402c-9399-9d1dc4f8f6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94529f4d-8097-43f3-a079-d658d4a40471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-aeeb603f-3ad5-4506-8ba6-2aac5cf8eccd tempest-VolumesActionsTest-747161382 None] Lock "cinder-082f915b-8426-4d2b-8c1b-3707d6aa44c4-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-cc2386c7-c6e0-456d-8d9e-1ac43473b942 req-26a736f0-26f1-4729-8f97-7515b1baa79a tempest-AttachVolumeTestJSON-641953485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ef146fcd-268c-4570-a80a-3793e038738f" returned: 0 in 1.182s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-cc2386c7-c6e0-456d-8d9e-1ac43473b942 req-26a736f0-26f1-4729-8f97-7515b1baa79a tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.237s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94529f4d-8097-43f3-a079-d658d4a40471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1417833531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5556395b-0d88-4689-a531-024b906c8192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecaf945757a648f5a4c8dbd5d6b3a1d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:32Z,use_quota=True,user_id='4f76bff00d3f406fbf7817132b13fc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb48c23-3a33-41ac-9149-4a9c9439f29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb48c23-3a33-41ac-9149-4a9c9439f29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f05f88-ef5d-419c-ad85-a9733a8dd0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f05f88-ef5d-419c-ad85-a9733a8dd0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5556395b-0d88-4689-a531-024b906c8192', 'volume_name': 'volume-5556395b-0d88-4689-a531-024b906c8192', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60601573-2201-4c49-a998-a769ef2129e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60601573-2201-4c49-a998-a769ef2129e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14ffacd-528e-4a7e-a068-c128afd3cce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:32 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Volume 5556395b-0d88-4689-a531-024b906c8192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5556395b-0d88-4689-a531-024b906c8192', 'volume_size': 1} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1417833531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5556395b-0d88-4689-a531-024b906c8192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecaf945757a648f5a4c8dbd5d6b3a1d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:32Z,use_quota=True,user_id='4f76bff00d3f406fbf7817132b13fc10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Creating volume 5556395b-0d88-4689-a531-024b906c8192 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:09:32 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5556395b-0d88-4689-a531-024b906c8192 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:32 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5556395b-0d88-4689-a531-024b906c8192 1073741824 Jun 25 17:09:32 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-cc2386c7-c6e0-456d-8d9e-1ac43473b942 req-26a736f0-26f1-4729-8f97-7515b1baa79a tempest-AttachVolumeTestJSON-641953485 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-ef146fcd-268c-4570-a80a-3793e038738f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f1f5489c-9e33-4e8c-8b39-93c9ec87f5c6', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:09:32 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-cc2386c7-c6e0-456d-8d9e-1ac43473b942 req-26a736f0-26f1-4729-8f97-7515b1baa79a tempest-AttachVolumeTestJSON-641953485 None] attachment_update completed successfully. Jun 25 17:09:33 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-eac4bf2d-3114-4b02-898d-e809961d7832 tempest-VolumeQuotasAdminTestJSON-1262551950 None] Transfer volume completed successfully. Jun 25 17:09:33 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5556395b-0d88-4689-a531-024b906c8192 1073741824" returned: 0 in 1.003s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5556395b-0d88-4689-a531-024b906c8192 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:33 devstack sudo[101577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5556395b-0d88-4689-a531-024b906c8192 Jun 25 17:09:33 devstack sudo[101577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:34 devstack sudo[101577]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5556395b-0d88-4689-a531-024b906c8192" returned: 0 in 0.767s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:34 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:09:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14ffacd-528e-4a7e-a068-c128afd3cce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5556395b-0d88-4689-a531-024b906c8192', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4aa9baa-8219-4c1e-84b5-fb506c68d280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:34 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Volume volume-5556395b-0d88-4689-a531-024b906c8192 (5556395b-0d88-4689-a531-024b906c8192): created successfully Jun 25 17:09:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4aa9baa-8219-4c1e-84b5-fb506c68d280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Flow 'volume_create_manager' (8f2b4dc7-6008-402c-9399-9d1dc4f8f6e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:34 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-383ab2de-bdbd-4f04-9eee-1d0da2bcfa80 tempest-VolumesActionsTest-2001748675 None] Created volume successfully. Jun 25 17:09:34 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] Acquiring lock "cinder-f021fec4-d8db-4705-bc57-de61be819541-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:09:34 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] Lock "cinder-f021fec4-d8db-4705-bc57-de61be819541-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:09:34 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] Acquiring lock "cinder-quobyte-f021fec4-d8db-4705-bc57-de61be819541" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:09:34 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] Lock "cinder-quobyte-f021fec4-d8db-4705-bc57-de61be819541" acquired by "delete_volume" :: waited 0.017s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:09:34 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d5dd2d-2f2b-4b3f-b299-4e42ca40b3af]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:09:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f021fec4-d8db-4705-bc57-de61be819541 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:34 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f021fec4-d8db-4705-bc57-de61be819541 Jun 25 17:09:34 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:35 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] Acquiring lock "cinder-5556395b-0d88-4689-a531-024b906c8192-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:09:35 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] Lock "cinder-5556395b-0d88-4689-a531-024b906c8192-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:09:35 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f021fec4-d8db-4705-bc57-de61be819541" returned: 0 in 0.854s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f021fec4-d8db-4705-bc57-de61be819541 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:35 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f021fec4-d8db-4705-bc57-de61be819541 Jun 25 17:09:35 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:35 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] Acquiring lock "cinder-quobyte-5556395b-0d88-4689-a531-024b906c8192" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:09:35 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] Lock "cinder-quobyte-5556395b-0d88-4689-a531-024b906c8192" acquired by "delete_volume" :: waited 0.019s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:09:35 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a8c095-3e82-4162-9545-4404cfd26ce9]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:09:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5556395b-0d88-4689-a531-024b906c8192 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:35 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5556395b-0d88-4689-a531-024b906c8192 Jun 25 17:09:35 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:36 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f021fec4-d8db-4705-bc57-de61be819541" returned: 0 in 0.711s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:36 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] Lock "cinder-quobyte-f021fec4-d8db-4705-bc57-de61be819541" released by "delete_volume" :: held 1.612s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:09:36 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] Created reservations ['d3188edf-b2ec-470d-a9b6-33070ddca64f', '11f245f5-d958-4ff6-82f7-3984f43efed9', '96c4cac4-801f-4537-b868-bac41290dbd1', '300f1001-1edd-47cb-b122-ffad1633aa97'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:09:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:36 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:09:36 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:36 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5556395b-0d88-4689-a531-024b906c8192" returned: 0 in 0.904s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5556395b-0d88-4689-a531-024b906c8192 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:36 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5556395b-0d88-4689-a531-024b906c8192 Jun 25 17:09:36 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:37 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.786s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:37 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:09:37 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] Deleted volume successfully. Jun 25 17:09:37 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6e242d0f-8e1f-484a-a273-d98b9325414d tempest-VolumeQuotasAdminTestJSON-1942101141 None] Lock "cinder-f021fec4-d8db-4705-bc57-de61be819541-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:09:37 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5556395b-0d88-4689-a531-024b906c8192" returned: 0 in 0.805s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:37 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] Lock "cinder-quobyte-5556395b-0d88-4689-a531-024b906c8192" released by "delete_volume" :: held 1.800s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:09:37 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] Created reservations ['78fb954e-6f3d-4953-8807-a858dc879979', '7c330309-78eb-4864-a969-941291abf17a', 'fbabd6d1-f70a-47dc-97db-19f7a37e4ec4', '0107610e-1b8f-4fcd-a2b2-472209e424f8'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:09:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:37 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:37 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:37 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:09:37 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:38 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.254s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:38 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:09:38 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] Deleted volume successfully. Jun 25 17:09:38 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-77f83dd9-589d-4dd9-b0fe-0c569193fd0e tempest-VolumesActionsTest-2001748675 None] Lock "cinder-5556395b-0d88-4689-a531-024b906c8192-delete_volume" released by "delete_volume" :: held 3.411s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:09:40 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-70734f1d-c1b6-43bf-9a23-ac024cf2cb69 req-2d6a8224-e366-463a-9ac5-118066ad8994 tempest-AttachVolumeTestJSON-641953485 None] Terminate volume connection completed successfully. Jun 25 17:09:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-70734f1d-c1b6-43bf-9a23-ac024cf2cb69 req-2d6a8224-e366-463a-9ac5-118066ad8994 tempest-AttachVolumeTestJSON-641953485 None] Deleting attachment f3240584-a30f-486b-b225-863f3382c11f. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:09:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:09:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:44 devstack sudo[101666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:09:44 devstack sudo[101666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:44 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-ee6b6026-5c68-4303-b700-056deec17395 req-7269de72-9168-4a29-b357-2e8a8f395f83 tempest-AttachVolumeTestJSON-641953485 None] Terminate volume connection completed successfully. Jun 25 17:09:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-ee6b6026-5c68-4303-b700-056deec17395 req-7269de72-9168-4a29-b357-2e8a8f395f83 tempest-AttachVolumeTestJSON-641953485 None] Deleting attachment f1f5489c-9e33-4e8c-8b39-93c9ec87f5c6. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:09:45 devstack sudo[101666]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.093s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:09:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:09:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 8 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:09:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:09:47 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-3015af0a-9168-4a44-b0b9-5d8760eaa6ef req-7f2ffbda-41ae-4c5c-a016-27d94a8145d1 tempest-AttachVolumeNegativeTest-109492441 None] Terminate volume connection completed successfully. Jun 25 17:09:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-3015af0a-9168-4a44-b0b9-5d8760eaa6ef req-7f2ffbda-41ae-4c5c-a016-27d94a8145d1 tempest-AttachVolumeNegativeTest-109492441 None] Deleting attachment 2d0f5798-cdf3-46b8-80b1-f15023891341. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Flow 'volume_create_manager' (e8146269-7976-40a6-bcdd-efae9c80c2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8d4f26-1df2-4f22-a241-a835cfd6de03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8d4f26-1df2-4f22-a241-a835cfd6de03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-5135029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30357eb5-8164-470e-9d05-c4467a9e3d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9239f45a8524924974322411e7a6b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:49Z,use_quota=True,user_id='1bb568c0b14d465a82700afba5d30df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fa85021-6e11-478b-b4f4-debad9f13943),volume_type_id=8fa85021-6e11-478b-b4f4-debad9f13943)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80472ad-a737-4786-b968-e5a1c93973e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80472ad-a737-4786-b968-e5a1c93973e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a666ff-a509-48fa-a484-f17d8351f45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a666ff-a509-48fa-a484-f17d8351f45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30357eb5-8164-470e-9d05-c4467a9e3d06', 'volume_name': 'volume-30357eb5-8164-470e-9d05-c4467a9e3d06', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7cdf05-94ed-4a66-8391-1984503f5834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7cdf05-94ed-4a66-8391-1984503f5834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0758be-d3f0-40ed-845b-02467be13a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:49 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Volume 30357eb5-8164-470e-9d05-c4467a9e3d06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30357eb5-8164-470e-9d05-c4467a9e3d06', 'volume_size': 1} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-5135029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30357eb5-8164-470e-9d05-c4467a9e3d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9239f45a8524924974322411e7a6b10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:49Z,use_quota=True,user_id='1bb568c0b14d465a82700afba5d30df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fa85021-6e11-478b-b4f4-debad9f13943),volume_type_id=8fa85021-6e11-478b-b4f4-debad9f13943)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Creating volume 30357eb5-8164-470e-9d05-c4467a9e3d06 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:09:49 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:09:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-30357eb5-8164-470e-9d05-c4467a9e3d06 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:49 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-30357eb5-8164-470e-9d05-c4467a9e3d06 1073741824 Jun 25 17:09:49 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:51 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-30357eb5-8164-470e-9d05-c4467a9e3d06 1073741824" returned: 0 in 1.680s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-30357eb5-8164-470e-9d05-c4467a9e3d06 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:51 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-30357eb5-8164-470e-9d05-c4467a9e3d06 Jun 25 17:09:51 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:52 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-30357eb5-8164-470e-9d05-c4467a9e3d06" returned: 0 in 1.157s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] <== create_volume: return (2924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:09:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.927s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e0758be-d3f0-40ed-845b-02467be13a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30357eb5-8164-470e-9d05-c4467a9e3d06', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b95dd3c-479f-4d14-8b88-ab4bedbbc226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:52 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Volume volume-30357eb5-8164-470e-9d05-c4467a9e3d06 (30357eb5-8164-470e-9d05-c4467a9e3d06): created successfully Jun 25 17:09:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b95dd3c-479f-4d14-8b88-ab4bedbbc226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Flow 'volume_create_manager' (e8146269-7976-40a6-bcdd-efae9c80c2d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:52 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-fe332e64-8f01-4d11-8611-0320ffaa59a2 tempest-VolumeTypesAccessTest-785587658 None] Created volume successfully. Jun 25 17:09:53 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] Acquiring lock "cinder-30357eb5-8164-470e-9d05-c4467a9e3d06-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:09:53 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] Lock "cinder-30357eb5-8164-470e-9d05-c4467a9e3d06-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:09:53 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] Acquiring lock "cinder-quobyte-30357eb5-8164-470e-9d05-c4467a9e3d06" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:09:53 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] Lock "cinder-quobyte-30357eb5-8164-470e-9d05-c4467a9e3d06" acquired by "delete_volume" :: waited 0.018s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:09:54 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[059225bb-c278-4fe4-be6f-8a4285ae9860]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:09:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-30357eb5-8164-470e-9d05-c4467a9e3d06 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:54 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-30357eb5-8164-470e-9d05-c4467a9e3d06 Jun 25 17:09:54 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:54 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-30357eb5-8164-470e-9d05-c4467a9e3d06" returned: 0 in 0.901s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-30357eb5-8164-470e-9d05-c4467a9e3d06 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:54 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-30357eb5-8164-470e-9d05-c4467a9e3d06 Jun 25 17:09:54 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:55 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-30357eb5-8164-470e-9d05-c4467a9e3d06" returned: 0 in 0.724s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:55 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] Lock "cinder-quobyte-30357eb5-8164-470e-9d05-c4467a9e3d06" released by "delete_volume" :: held 1.718s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:09:55 devstack cinder-volume[93869]: WARNING cinder.quota [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-503880143 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-503880143, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:09:55 devstack cinder-volume[93869]: WARNING cinder.quota [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-503880143 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-503880143, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:09:55 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] Created reservations ['f22238a5-c56a-49f0-92c2-7627826c3e40', 'a58a7911-cd8c-44ca-9775-5b090aa2fc11', 'da4e7e86-8b84-4147-a60f-38b40099daa0', '101ae926-db27-4e84-afee-50982fde7fbe'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:09:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:55 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:09:55 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:56 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.029s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:56 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:09:56 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] Deleted volume successfully. Jun 25 17:09:56 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-50fdd894-2813-4e48-a9c1-a9be6289e878 tempest-VolumeTypesAccessTest-785587658 None] Lock "cinder-30357eb5-8164-470e-9d05-c4467a9e3d06-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:09:56 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] Acquiring lock "cinder-ef146fcd-268c-4570-a80a-3793e038738f-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:09:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] Lock "cinder-ef146fcd-268c-4570-a80a-3793e038738f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:09:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] Acquiring lock "cinder-quobyte-ef146fcd-268c-4570-a80a-3793e038738f" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:09:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] Lock "cinder-quobyte-ef146fcd-268c-4570-a80a-3793e038738f" acquired by "delete_volume" :: waited 0.022s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:09:57 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f851f4ee-4f66-41dd-8bfc-e0451b5513a1]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:09:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ef146fcd-268c-4570-a80a-3793e038738f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:57 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ef146fcd-268c-4570-a80a-3793e038738f Jun 25 17:09:57 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:58 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ef146fcd-268c-4570-a80a-3793e038738f" returned: 0 in 0.933s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ef146fcd-268c-4570-a80a-3793e038738f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:58 devstack sudo[101817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ef146fcd-268c-4570-a80a-3793e038738f Jun 25 17:09:58 devstack sudo[101817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:59 devstack sudo[101817]: pam_unix(sudo:session): session closed for user root Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ef146fcd-268c-4570-a80a-3793e038738f" returned: 0 in 0.932s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] Lock "cinder-quobyte-ef146fcd-268c-4570-a80a-3793e038738f" released by "delete_volume" :: held 1.974s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Flow 'volume_create_manager' (eb62d2b9-17e1-49f5-bd80-08b45c691dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60276dfe-d039-49d2-ae1f-395e20871cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60276dfe-d039-49d2-ae1f-395e20871cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1164366939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9fb5812-31a4-4f27-b472-3dff74b84c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0580632bde404ab41e80962a3f950c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:59Z,use_quota=True,user_id='717b3fdb87224c988e7b44c475a1997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95180d70-9575-4087-9e85-d76c1b59e6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95180d70-9575-4087-9e85-d76c1b59e6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d0f8778-0c31-4eec-97d1-6e0d4be30250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d0f8778-0c31-4eec-97d1-6e0d4be30250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9fb5812-31a4-4f27-b472-3dff74b84c7b', 'volume_name': 'volume-d9fb5812-31a4-4f27-b472-3dff74b84c7b', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21445084-ea9e-4921-a5fc-040e3458c38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21445084-ea9e-4921-a5fc-040e3458c38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1674a07-00cb-4cdc-976d-b16d4b8539f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:09:59 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Volume d9fb5812-31a4-4f27-b472-3dff74b84c7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9fb5812-31a4-4f27-b472-3dff74b84c7b', 'volume_size': 1} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1164366939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9fb5812-31a4-4f27-b472-3dff74b84c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0580632bde404ab41e80962a3f950c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:09:59Z,use_quota=True,user_id='717b3fdb87224c988e7b44c475a1997a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Creating volume d9fb5812-31a4-4f27-b472-3dff74b84c7b {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:09:59 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9fb5812-31a4-4f27-b472-3dff74b84c7b 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:59 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9fb5812-31a4-4f27-b472-3dff74b84c7b 1073741824 Jun 25 17:09:59 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] Created reservations ['19ece0bf-1f37-456c-9749-5bca620eb394', '7f426ec6-8945-4c45-91cf-5233b68259d1', '9a5fd51f-9c73-43b6-9a81-350c4d910814', '2df4e00f-565b-4425-b707-cebc7d932815'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:09:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:09:59 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:09:59 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:00 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] Acquiring lock "cinder-372ac2ee-d325-4cac-aa3c-a2983a389789-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:00 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.998s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:00 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:10:00 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] Deleted volume successfully. Jun 25 17:10:00 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] Lock "cinder-372ac2ee-d325-4cac-aa3c-a2983a389789-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:00 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-429a377e-f468-4484-afe6-d194164d1b1b tempest-AttachVolumeTestJSON-641953485 None] Lock "cinder-ef146fcd-268c-4570-a80a-3793e038738f-delete_volume" released by "delete_volume" :: held 3.613s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:00 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] Acquiring lock "cinder-quobyte-372ac2ee-d325-4cac-aa3c-a2983a389789" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:00 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] Lock "cinder-quobyte-372ac2ee-d325-4cac-aa3c-a2983a389789" acquired by "delete_volume" :: waited 0.043s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:00 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9fb5812-31a4-4f27-b472-3dff74b84c7b 1073741824" returned: 0 in 1.507s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:00 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ebd163-e610-44b6-af8a-f4d402a27c7b]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:10:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-372ac2ee-d325-4cac-aa3c-a2983a389789 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9fb5812-31a4-4f27-b472-3dff74b84c7b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:00 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9fb5812-31a4-4f27-b472-3dff74b84c7b Jun 25 17:10:00 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:00 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-372ac2ee-d325-4cac-aa3c-a2983a389789 Jun 25 17:10:00 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:01 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9fb5812-31a4-4f27-b472-3dff74b84c7b" returned: 0 in 0.872s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] <== create_volume: return (2462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:10:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.465s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1674a07-00cb-4cdc-976d-b16d4b8539f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9fb5812-31a4-4f27-b472-3dff74b84c7b', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b18761-8844-4b3e-a50d-961f4c992325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:01 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Volume volume-d9fb5812-31a4-4f27-b472-3dff74b84c7b (d9fb5812-31a4-4f27-b472-3dff74b84c7b): created successfully Jun 25 17:10:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b18761-8844-4b3e-a50d-961f4c992325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Flow 'volume_create_manager' (eb62d2b9-17e1-49f5-bd80-08b45c691dec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:10:01 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-e5c17581-a8b8-4d8d-9770-8fcfa8adb412 tempest-VolumesMetadataTest-522599449 None] Created volume successfully. Jun 25 17:10:01 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-372ac2ee-d325-4cac-aa3c-a2983a389789" returned: 0 in 1.188s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-372ac2ee-d325-4cac-aa3c-a2983a389789 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:01 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-372ac2ee-d325-4cac-aa3c-a2983a389789 Jun 25 17:10:01 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:02 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-372ac2ee-d325-4cac-aa3c-a2983a389789" returned: 0 in 0.922s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] Lock "cinder-quobyte-372ac2ee-d325-4cac-aa3c-a2983a389789" released by "delete_volume" :: held 2.181s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:02 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] Created reservations ['6e63bc32-f36d-4c04-a282-93f7a76b07ef', '8383d044-7aad-4ac2-bb56-447fbff41936', '5b8792e6-f0a4-4393-9321-24b88709d02d', 'efefd118-0750-4121-8d5e-08a2bff48755'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:10:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:03 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:10:03 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:10:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:03 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:10:03 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] Acquiring lock "cinder-d9fb5812-31a4-4f27-b472-3dff74b84c7b-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] Lock "cinder-d9fb5812-31a4-4f27-b472-3dff74b84c7b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] Acquiring lock "cinder-quobyte-d9fb5812-31a4-4f27-b472-3dff74b84c7b" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] Lock "cinder-quobyte-d9fb5812-31a4-4f27-b472-3dff74b84c7b" acquired by "delete_volume" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:03 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa21ce8a-e3b1-4fca-9579-4f1d3106d87e]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:10:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9fb5812-31a4-4f27-b472-3dff74b84c7b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:03 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9fb5812-31a4-4f27-b472-3dff74b84c7b Jun 25 17:10:03 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:03 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.923s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:03 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:10:03 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] Deleted volume successfully. Jun 25 17:10:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8c773e12-f8d6-4e21-875e-4bd90ee715fd tempest-AttachVolumeTestJSON-641953485 None] Lock "cinder-372ac2ee-d325-4cac-aa3c-a2983a389789-delete_volume" released by "delete_volume" :: held 3.438s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] Acquiring lock "cinder-d5e5807a-0fab-48c7-80b0-31952d07ae48-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] Lock "cinder-d5e5807a-0fab-48c7-80b0-31952d07ae48-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] Acquiring lock "cinder-quobyte-d5e5807a-0fab-48c7-80b0-31952d07ae48" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] Lock "cinder-quobyte-d5e5807a-0fab-48c7-80b0-31952d07ae48" acquired by "delete_volume" :: waited 0.025s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:04 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0da2b24-7e5a-4548-931a-62d4670b1ac8]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:10:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d5e5807a-0fab-48c7-80b0-31952d07ae48 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:04 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d5e5807a-0fab-48c7-80b0-31952d07ae48 Jun 25 17:10:04 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:04 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9fb5812-31a4-4f27-b472-3dff74b84c7b" returned: 0 in 1.149s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9fb5812-31a4-4f27-b472-3dff74b84c7b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:04 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9fb5812-31a4-4f27-b472-3dff74b84c7b Jun 25 17:10:04 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:05 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d5e5807a-0fab-48c7-80b0-31952d07ae48" returned: 0 in 1.036s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d5e5807a-0fab-48c7-80b0-31952d07ae48 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:05 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d5e5807a-0fab-48c7-80b0-31952d07ae48 Jun 25 17:10:05 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:05 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9fb5812-31a4-4f27-b472-3dff74b84c7b" returned: 0 in 0.897s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] Lock "cinder-quobyte-d9fb5812-31a4-4f27-b472-3dff74b84c7b" released by "delete_volume" :: held 2.138s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:05 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] Created reservations ['cee4afd2-0cab-4c7f-9043-842dbe3e8f76', '7c0b12ca-7d11-41fd-b3d2-c71b2dbb44b2', 'bd5477d7-c1ac-43c1-a9e7-1433f0833b5b', 'c0c548e3-fc1d-4ee8-919f-b090b076d6d2'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:10:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:10:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:10:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:05 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:10:05 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:06 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d5e5807a-0fab-48c7-80b0-31952d07ae48" returned: 0 in 0.893s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] Lock "cinder-quobyte-d5e5807a-0fab-48c7-80b0-31952d07ae48" released by "delete_volume" :: held 2.003s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:06 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] Created reservations ['d4a8e979-82a3-4113-a1fa-56ec5b191d7d', '7cdb8009-16cc-486f-bcd6-87a57dd5db87', 'dc15218f-e3fd-488b-aace-b8eb9eb8abbf', '19e0e0e4-c726-41ab-9ff5-9db99f8050b4'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:10:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:10:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:10:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:06 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:10:06 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:06 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.879s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:06 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:10:06 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] Deleted volume successfully. Jun 25 17:10:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-323b6c18-a78b-4ee3-b45c-030ff1803b5d tempest-VolumesMetadataTest-522599449 None] Lock "cinder-d9fb5812-31a4-4f27-b472-3dff74b84c7b-delete_volume" released by "delete_volume" :: held 3.359s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:07 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.831s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:07 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:10:07 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] Deleted volume successfully. Jun 25 17:10:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a7f631a7-1055-44e9-9366-1d54a2e599de tempest-AttachVolumeTestJSON-641953485 None] Lock "cinder-d5e5807a-0fab-48c7-80b0-31952d07ae48-delete_volume" released by "delete_volume" :: held 3.136s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:11 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:10:11 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Flow 'volume_create_manager' (38359d0c-5ffc-4bc1-9486-a456af418f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:10:11 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8efc328-89e8-4a23-a0fe-e6b78af02f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:11 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8efc328-89e8-4a23-a0fe-e6b78af02f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-675698270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1699e2eb-9836-42dc-9e27-fbedb724ec8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d9b13fe3914ff280cb4a827d88a305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:10:12Z,use_quota=True,user_id='3788dd1a126e4882847c0f0583e06463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:11 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c74178-820f-4afd-b5e2-7a33f98abf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:11 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c74178-820f-4afd-b5e2-7a33f98abf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994f2a63-13e3-4936-8efb-cd4c5ad9b686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (994f2a63-13e3-4936-8efb-cd4c5ad9b686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1699e2eb-9836-42dc-9e27-fbedb724ec8b', 'volume_name': 'volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2efefa7-63b0-41ae-9153-be1da585fac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2efefa7-63b0-41ae-9153-be1da585fac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39336252-8e65-4d64-8a03-6bfcc3b44d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:12 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Volume 1699e2eb-9836-42dc-9e27-fbedb724ec8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b', 'volume_size': 1} Jun 25 17:10:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-675698270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1699e2eb-9836-42dc-9e27-fbedb724ec8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01d9b13fe3914ff280cb4a827d88a305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:10:12Z,use_quota=True,user_id='3788dd1a126e4882847c0f0583e06463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:10:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Creating volume 1699e2eb-9836-42dc-9e27-fbedb724ec8b {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:10:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:10:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:10:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:10:12 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:10:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:12 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b 1073741824 Jun 25 17:10:12 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:13 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b 1073741824" returned: 0 in 1.538s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:13 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b Jun 25 17:10:13 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:15 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b" returned: 0 in 1.415s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] <== create_volume: return (3054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:10:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.057s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39336252-8e65-4d64-8a03-6bfcc3b44d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c21c350e-d03e-4957-ba4a-92f7c29e924e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:15 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Volume volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b (1699e2eb-9836-42dc-9e27-fbedb724ec8b): created successfully Jun 25 17:10:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c21c350e-d03e-4957-ba4a-92f7c29e924e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Flow 'volume_create_manager' (38359d0c-5ffc-4bc1-9486-a456af418f00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:10:15 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-4267afb7-25ed-4052-a10e-be07c6eac3ed tempest-VolumesSnapshotListTestJSON-1450530106 None] Created volume successfully. Jun 25 17:10:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-01dea793-43ca-47dc-af15-0d93c4998045 tempest-VolumesSnapshotListTestJSON-1450530106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-01dea793-43ca-47dc-af15-0d93c4998045 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-01dea793-43ca-47dc-af15-0d93c4998045 tempest-VolumesSnapshotListTestJSON-1450530106 None] Creating offline snapshot ffe19f5f-0a35-4cc5-8ac6-cf3757895399 of volume 1699e2eb-9836-42dc-9e27-fbedb724ec8b {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:10:16 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[223ac333-aa9f-4384-9892-d7c300804271]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:10:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-01dea793-43ca-47dc-af15-0d93c4998045 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:17 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b Jun 25 17:10:17 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:17 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-01dea793-43ca-47dc-af15-0d93c4998045 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b" returned: 0 in 1.070s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-01dea793-43ca-47dc-af15-0d93c4998045 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:18 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 1G Jun 25 17:10:18 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:18 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-415a26e9-755a-44a2-8511-b141afb98368 tempest-GroupSnapshotsTest-1879857753 None] Group tempest-GroupSnapshotsTest-Group-1552749468: creating Jun 25 17:10:18 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-415a26e9-755a-44a2-8511-b141afb98368 tempest-GroupSnapshotsTest-1879857753 None] Group tempest-GroupSnapshotsTest-Group-1552749468: created successfully Jun 25 17:10:18 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-415a26e9-755a-44a2-8511-b141afb98368 tempest-GroupSnapshotsTest-1879857753 None] Create group completed successfully. Jun 25 17:10:19 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-01dea793-43ca-47dc-af15-0d93c4998045 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 1G" returned: 0 in 1.197s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-01dea793-43ca-47dc-af15-0d93c4998045 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:19 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 Jun 25 17:10:19 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:20 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-01dea793-43ca-47dc-af15-0d93c4998045 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399" returned: 0 in 0.907s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:20 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-01dea793-43ca-47dc-af15-0d93c4998045 tempest-VolumesSnapshotListTestJSON-1450530106 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 is being set with open permissions: ugo+rw Jun 25 17:10:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-01dea793-43ca-47dc-af15-0d93c4998045 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:20 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 Jun 25 17:10:20 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:21 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:10:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Flow 'volume_create_manager' (43ff0203-56d7-41c7-be6b-5dca44890868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:10:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f69c23-85ec-43b1-bc3b-4cb5a3b010f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f69c23-85ec-43b1-bc3b-4cb5a3b010f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1388806322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78722888-d3b5-4fa5-b618-dfdfa3982d0d,host='devstack@QuobyteHD#QuobyteHD',id=2290c640-768b-46ab-8517-bbc40e7e47e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e82e4a1cca242a9a5fff464ca680b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:10:21Z,use_quota=True,user_id='f0bc8da5fe1e4b608a3757b09d0d2fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a935d8f9-3b7a-4b1b-b505-9f35263dcd68),volume_type_id=a935d8f9-3b7a-4b1b-b505-9f35263dcd68)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa2685c-8636-4718-8eec-4d2f7216bc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa2685c-8636-4718-8eec-4d2f7216bc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7759da64-6b8e-458f-ae90-fc43d583c07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7759da64-6b8e-458f-ae90-fc43d583c07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2290c640-768b-46ab-8517-bbc40e7e47e5', 'volume_name': 'volume-2290c640-768b-46ab-8517-bbc40e7e47e5', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561bb07d-7ac8-45a4-8399-b8bedc37328e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561bb07d-7ac8-45a4-8399-b8bedc37328e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b415f7f-65cf-4576-ad00-8a3505473e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:21 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Volume 2290c640-768b-46ab-8517-bbc40e7e47e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2290c640-768b-46ab-8517-bbc40e7e47e5', 'volume_size': 1} Jun 25 17:10:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:22 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-01dea793-43ca-47dc-af15-0d93c4998045 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399" returned: 0 in 2.050s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-01dea793-43ca-47dc-af15-0d93c4998045 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:22 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.info Jun 25 17:10:22 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:23 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-01dea793-43ca-47dc-af15-0d93c4998045 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.info" returned: 0 in 1.075s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:23 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-01dea793-43ca-47dc-af15-0d93c4998045 tempest-VolumesSnapshotListTestJSON-1450530106 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.info is being set with open permissions: ugo+rw Jun 25 17:10:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-01dea793-43ca-47dc-af15-0d93c4998045 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:23 devstack sudo[102051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.info Jun 25 17:10:23 devstack sudo[102051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:24 devstack sudo[102051]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-01dea793-43ca-47dc-af15-0d93c4998045 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.info" returned: 0 in 0.871s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-01dea793-43ca-47dc-af15-0d93c4998045 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.316s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.797s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=78722888-d3b5-4fa5-b618-dfdfa3982d0d,created_at=2026-06-25T15:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1388806322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=78722888-d3b5-4fa5-b618-dfdfa3982d0d,host='devstack@QuobyteHD#QuobyteHD',id=2290c640-768b-46ab-8517-bbc40e7e47e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e82e4a1cca242a9a5fff464ca680b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:10:21Z,use_quota=True,user_id='f0bc8da5fe1e4b608a3757b09d0d2fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a935d8f9-3b7a-4b1b-b505-9f35263dcd68),volume_type_id=a935d8f9-3b7a-4b1b-b505-9f35263dcd68)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:10:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Creating volume 2290c640-768b-46ab-8517-bbc40e7e47e5 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:10:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:10:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:10:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:10:24 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:10:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:24 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 1073741824 Jun 25 17:10:24 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:24 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-01dea793-43ca-47dc-af15-0d93c4998045 tempest-VolumesSnapshotListTestJSON-1450530106 None] Create snapshot completed successfully Jun 25 17:10:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b6b3f7e8-ee9d-442e-bfee-311becbf0e8a tempest-VolumesSnapshotListTestJSON-1450530106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:25 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=110,cinder:DELETE=9,cinder:SELECT=85,cinder:INSERT=24 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:10:25 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=71,cinder:INSERT=24,cinder:UPDATE=102,cinder:DELETE=10 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:10:25 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:25 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:10:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Flow 'volume_create_manager' (2cb985d0-7c3c-4980-97ee-2d2af01cca03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:10:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4ef6a5-67b2-4e73-8c57-d048f85732d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 1073741824" returned: 0 in 1.567s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4ef6a5-67b2-4e73-8c57-d048f85732d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1786524415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1765d97b-00fe-43b9-bd45-679a70440f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8da1b4423164547aed97af66072c3b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:10:26Z,use_quota=True,user_id='425547d473d942a98e34fcadf8962a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e215de82-d779-46e5-8afc-202f0b5ec00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e215de82-d779-46e5-8afc-202f0b5ec00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38451e7a-b120-4e62-bb53-63cbd9a81f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38451e7a-b120-4e62-bb53-63cbd9a81f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1765d97b-00fe-43b9-bd45-679a70440f59', 'volume_name': 'volume-1765d97b-00fe-43b9-bd45-679a70440f59', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f00b50e-3052-4c94-ac43-aaf0e10f5e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f00b50e-3052-4c94-ac43-aaf0e10f5e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67b5464-43bb-40fa-b2d0-5afc9a4d616b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:25 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Volume 1765d97b-00fe-43b9-bd45-679a70440f59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1765d97b-00fe-43b9-bd45-679a70440f59', 'volume_size': 1} Jun 25 17:10:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:25 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 Jun 25 17:10:25 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:26 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5" returned: 0 in 0.744s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] <== create_volume: return (2404ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:10:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.408s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b6b3f7e8-ee9d-442e-bfee-311becbf0e8a tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.827s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-b6b3f7e8-ee9d-442e-bfee-311becbf0e8a tempest-VolumesSnapshotListTestJSON-1450530106 None] Creating offline snapshot 63cd27f9-700c-4057-910d-9767713ab130 of volume 1699e2eb-9836-42dc-9e27-fbedb724ec8b {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:10:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b415f7f-65cf-4576-ad00-8a3505473e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2290c640-768b-46ab-8517-bbc40e7e47e5', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fd1dbe-1b30-44c6-bc1e-ffae899d074f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:26 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37d08c4-27ba-4109-b91e-61f6b9d1ec9d]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:10:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6b3f7e8-ee9d-442e-bfee-311becbf0e8a tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:26 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Volume volume-2290c640-768b-46ab-8517-bbc40e7e47e5 (2290c640-768b-46ab-8517-bbc40e7e47e5): created successfully Jun 25 17:10:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fd1dbe-1b30-44c6-bc1e-ffae899d074f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Flow 'volume_create_manager' (43ff0203-56d7-41c7-be6b-5dca44890868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:10:26 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-f2478b16-b144-41b9-9701-acc053d386fe tempest-GroupSnapshotsTest-1879857753 None] Created volume successfully. Jun 25 17:10:26 devstack sudo[102064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 Jun 25 17:10:26 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:27 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6b3f7e8-ee9d-442e-bfee-311becbf0e8a tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399" returned: 0 in 0.939s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-b6b3f7e8-ee9d-442e-bfee-311becbf0e8a tempest-VolumesSnapshotListTestJSON-1450530106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:10:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6b3f7e8-ee9d-442e-bfee-311becbf0e8a tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:27 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 1G Jun 25 17:10:27 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:28 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] GroupSnapshot 47922a51-11b1-4097-9889-0872f95c6e99: creating. Jun 25 17:10:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] Group snapshot 47922a51-11b1-4097-9889-0872f95c6e99: creating. {{(pid=93869) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 25 17:10:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:28 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6b3f7e8-ee9d-442e-bfee-311becbf0e8a tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 1G" returned: 0 in 1.180s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6b3f7e8-ee9d-442e-bfee-311becbf0e8a tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:28 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 Jun 25 17:10:28 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:29 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6b3f7e8-ee9d-442e-bfee-311becbf0e8a tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130" returned: 0 in 0.759s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:29 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-b6b3f7e8-ee9d-442e-bfee-311becbf0e8a tempest-VolumesSnapshotListTestJSON-1450530106 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 is being set with open permissions: ugo+rw Jun 25 17:10:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6b3f7e8-ee9d-442e-bfee-311becbf0e8a tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:29 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 Jun 25 17:10:29 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:30 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6b3f7e8-ee9d-442e-bfee-311becbf0e8a tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130" returned: 0 in 0.746s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b6b3f7e8-ee9d-442e-bfee-311becbf0e8a tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.771s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.554s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:30 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:10:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1786524415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1765d97b-00fe-43b9-bd45-679a70440f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8da1b4423164547aed97af66072c3b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:10:26Z,use_quota=True,user_id='425547d473d942a98e34fcadf8962a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:10:30 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Creating volume 1765d97b-00fe-43b9-bd45-679a70440f59 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:10:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:30 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:10:30 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:10:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:30 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:10:30 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:10:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1765d97b-00fe-43b9-bd45-679a70440f59 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:30 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1765d97b-00fe-43b9-bd45-679a70440f59 1073741824 Jun 25 17:10:30 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:30 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b6b3f7e8-ee9d-442e-bfee-311becbf0e8a tempest-VolumesSnapshotListTestJSON-1450530106 None] Create snapshot completed successfully Jun 25 17:10:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d0c446ca-1275-4f3a-aae7-f541d7e35db7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:31 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1765d97b-00fe-43b9-bd45-679a70440f59 1073741824" returned: 0 in 1.139s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1765d97b-00fe-43b9-bd45-679a70440f59 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:31 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1765d97b-00fe-43b9-bd45-679a70440f59 Jun 25 17:10:31 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:32 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1765d97b-00fe-43b9-bd45-679a70440f59" returned: 0 in 0.757s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:32 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:10:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.737s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67b5464-43bb-40fa-b2d0-5afc9a4d616b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1765d97b-00fe-43b9-bd45-679a70440f59', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3318cc-4784-4349-9c89-78f5b09c0b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:32 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] Creating offline snapshot 9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 of volume 2290c640-768b-46ab-8517-bbc40e7e47e5 {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:10:32 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Volume volume-1765d97b-00fe-43b9-bd45-679a70440f59 (1765d97b-00fe-43b9-bd45-679a70440f59): created successfully Jun 25 17:10:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c3318cc-4784-4349-9c89-78f5b09c0b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Flow 'volume_create_manager' (2cb985d0-7c3c-4980-97ee-2d2af01cca03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:10:32 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0946ebf0-055a-4703-b895-2b0d8fe460f4]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:10:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:32 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-bebae425-cf3a-419a-bb38-bd4d4233e4e8 tempest-VolumesTransfersV355Test-1848339006 None] Created volume successfully. Jun 25 17:10:32 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 Jun 25 17:10:32 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:33 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5" returned: 0 in 0.789s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:33 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 1G Jun 25 17:10:33 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:34 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-fb9bba91-41ce-4747-9acd-96676a5ed570 tempest-VolumesTransfersV355Test-2004378203 None] Transfer volume completed successfully. Jun 25 17:10:34 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 1G" returned: 0 in 1.102s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2290c640-768b-46ab-8517-bbc40e7e47e5 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:34 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2290c640-768b-46ab-8517-bbc40e7e47e5 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 Jun 25 17:10:34 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:35 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2290c640-768b-46ab-8517-bbc40e7e47e5 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0" returned: 0 in 0.804s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:35 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 is being set with open permissions: ugo+rw: NotImplementedError Jun 25 17:10:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:35 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] Acquiring lock "cinder-1765d97b-00fe-43b9-bd45-679a70440f59-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:35 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 Jun 25 17:10:35 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:35 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] Lock "cinder-1765d97b-00fe-43b9-bd45-679a70440f59-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:35 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] Acquiring lock "cinder-quobyte-1765d97b-00fe-43b9-bd45-679a70440f59" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:35 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] Lock "cinder-quobyte-1765d97b-00fe-43b9-bd45-679a70440f59" acquired by "delete_volume" :: waited 0.031s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:35 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8177fd35-080b-4935-ac70-824eea430526]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:10:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1765d97b-00fe-43b9-bd45-679a70440f59 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:35 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1765d97b-00fe-43b9-bd45-679a70440f59 Jun 25 17:10:35 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:36 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1765d97b-00fe-43b9-bd45-679a70440f59" returned: 0 in 0.901s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1765d97b-00fe-43b9-bd45-679a70440f59 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:36 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1765d97b-00fe-43b9-bd45-679a70440f59 Jun 25 17:10:36 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:36 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0" returned: 0 in 1.134s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:36 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.info Jun 25 17:10:36 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:36 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1765d97b-00fe-43b9-bd45-679a70440f59" returned: 0 in 0.696s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:36 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] Lock "cinder-quobyte-1765d97b-00fe-43b9-bd45-679a70440f59" released by "delete_volume" :: held 1.678s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:36 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] Created reservations ['79a4370d-108c-4cf6-b53b-0c83a2dffc1b', '5a8fcacd-8eb6-44d8-9cfd-4193a2b061ff', '0041f0ae-58d2-4712-a282-5caa3e92fa97', '890adb84-c9c8-438e-b6cc-39653557994b'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:10:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:37 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:10:37 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:10:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:37 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:10:37 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:37 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.info" returned: 0 in 0.919s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:37 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.info is being set with open permissions: ugo+rw: NotImplementedError Jun 25 17:10:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:37 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.info Jun 25 17:10:37 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:37 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.756s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:37 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:10:37 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] Deleted volume successfully. Jun 25 17:10:37 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7242ddc3-5cf8-489c-b927-3c0b093724f2 tempest-VolumesTransfersV355Test-771222561 None] Lock "cinder-1765d97b-00fe-43b9-bd45-679a70440f59-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:38 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:10:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Flow 'volume_create_manager' (4de3bbf6-462d-4882-b1c5-e39f3119d443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:10:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0bc3e29-c8ab-495e-9044-8669466f7a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0bc3e29-c8ab-495e-9044-8669466f7a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-713892442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1427e220-6e4a-4556-82db-4d2b7be96a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8da1b4423164547aed97af66072c3b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:10:38Z,use_quota=True,user_id='425547d473d942a98e34fcadf8962a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc05e3fc-753b-47cd-88fe-141bd1898b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc05e3fc-753b-47cd-88fe-141bd1898b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca925a04-e0e5-4dd5-97d6-3b74eaa7fc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca925a04-e0e5-4dd5-97d6-3b74eaa7fc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1427e220-6e4a-4556-82db-4d2b7be96a1c', 'volume_name': 'volume-1427e220-6e4a-4556-82db-4d2b7be96a1c', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:38 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3efc2b-3e9c-404c-992b-a89f7eb50a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3efc2b-3e9c-404c-992b-a89f7eb50a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfad2b1-99c6-41c8-9915-c56aad9ba319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:38 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Volume 1427e220-6e4a-4556-82db-4d2b7be96a1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1427e220-6e4a-4556-82db-4d2b7be96a1c', 'volume_size': 1} Jun 25 17:10:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.info" returned: 0 in 1.006s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.906s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d0c446ca-1275-4f3a-aae7-f541d7e35db7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.882s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-d0c446ca-1275-4f3a-aae7-f541d7e35db7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Creating offline snapshot 79defe51-0f61-4152-b9a7-b455e02af1a9 of volume 1699e2eb-9836-42dc-9e27-fbedb724ec8b {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:10:38 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f7a1b4-ca10-473a-a848-6478caeddf71]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:10:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d0c446ca-1275-4f3a-aae7-f541d7e35db7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:38 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-25dac07e-bd4a-4112-bf90-c431f42c00d9 tempest-GroupSnapshotsTest-1879857753 None] group_snapshot 47922a51-11b1-4097-9889-0872f95c6e99: created successfully Jun 25 17:10:38 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 Jun 25 17:10:38 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:39 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d0c446ca-1275-4f3a-aae7-f541d7e35db7 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130" returned: 0 in 0.890s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-d0c446ca-1275-4f3a-aae7-f541d7e35db7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:10:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d0c446ca-1275-4f3a-aae7-f541d7e35db7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:39 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9 1G Jun 25 17:10:39 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:40 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d0c446ca-1275-4f3a-aae7-f541d7e35db7 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9 1G" returned: 0 in 1.105s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d0c446ca-1275-4f3a-aae7-f541d7e35db7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:40 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9 Jun 25 17:10:40 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:41 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d0c446ca-1275-4f3a-aae7-f541d7e35db7 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9" returned: 0 in 0.801s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:41 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-d0c446ca-1275-4f3a-aae7-f541d7e35db7 tempest-VolumesSnapshotListTestJSON-1450530106 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9 is being set with open permissions: ugo+rw Jun 25 17:10:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d0c446ca-1275-4f3a-aae7-f541d7e35db7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:41 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9 Jun 25 17:10:41 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:41 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d0c446ca-1275-4f3a-aae7-f541d7e35db7 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9" returned: 0 in 0.699s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d0c446ca-1275-4f3a-aae7-f541d7e35db7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.618s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.642s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-713892442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1427e220-6e4a-4556-82db-4d2b7be96a1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8da1b4423164547aed97af66072c3b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:10:38Z,use_quota=True,user_id='425547d473d942a98e34fcadf8962a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:10:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Creating volume 1427e220-6e4a-4556-82db-4d2b7be96a1c {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:10:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:10:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:10:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:10:41 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:10:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1427e220-6e4a-4556-82db-4d2b7be96a1c 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:41 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1427e220-6e4a-4556-82db-4d2b7be96a1c 1073741824 Jun 25 17:10:41 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:41 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-d0c446ca-1275-4f3a-aae7-f541d7e35db7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Create snapshot completed successfully Jun 25 17:10:42 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1427e220-6e4a-4556-82db-4d2b7be96a1c 1073741824" returned: 0 in 0.922s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1427e220-6e4a-4556-82db-4d2b7be96a1c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:42 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1427e220-6e4a-4556-82db-4d2b7be96a1c Jun 25 17:10:42 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:43 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1427e220-6e4a-4556-82db-4d2b7be96a1c" returned: 0 in 0.858s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.210s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "cinder-quobyte-9b0d7af9-4a6c-4d70-9c46-1c183a310dd0-ac68cdde-0c0d-46a5-b454-9b537366b5bc" by "_create_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dfad2b1-99c6-41c8-9915-c56aad9ba319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1427e220-6e4a-4556-82db-4d2b7be96a1c', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748d85a4-76c1-43c5-b990-93ba65b11fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-9b0d7af9-4a6c-4d70-9c46-1c183a310dd0-ac68cdde-0c0d-46a5-b454-9b537366b5bc" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Creating volume ac68cdde-0c0d-46a5-b454-9b537366b5bc from snapshot 9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 {{(pid=93869) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "cinder-quobyte-ac68cdde-0c0d-46a5-b454-9b537366b5bc" by "_copy_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:43 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Volume volume-1427e220-6e4a-4556-82db-4d2b7be96a1c (1427e220-6e4a-4556-82db-4d2b7be96a1c): created successfully Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748d85a4-76c1-43c5-b990-93ba65b11fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Flow 'volume_create_manager' (4de3bbf6-462d-4882-b1c5-e39f3119d443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-ac68cdde-0c0d-46a5-b454-9b537366b5bc" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] snapshot: 9b0d7af9-4a6c-4d70-9c46-1c183a310dd0, volume: ac68cdde-0c0d-46a5-b454-9b537366b5bc, {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 17:10:43 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-abd9d884-c81d-4f1f-ad63-b100ab3f7475 tempest-VolumesTransfersV355Test-1848339006 None] Created volume successfully. Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee29a256-7bf5-4cf6-b1b1-6d87b08dae11]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:10:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:43 devstack sudo[102183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 Jun 25 17:10:43 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] Acquiring lock "cinder-79defe51-0f61-4152-b9a7-b455e02af1a9-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-79defe51-0f61-4152-b9a7-b455e02af1a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] Acquiring lock "cinder-quobyte-1699e2eb-9836-42dc-9e27-fbedb724ec8b" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-quobyte-1699e2eb-9836-42dc-9e27-fbedb724ec8b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] Acquiring lock "cinder-quobyte-79defe51-0f61-4152-b9a7-b455e02af1a9" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-quobyte-79defe51-0f61-4152-b9a7-b455e02af1a9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] Deleting offline snapshot 79defe51-0f61-4152-b9a7-b455e02af1a9 of volume 1699e2eb-9836-42dc-9e27-fbedb724ec8b {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] snapshot_file for this snap is: volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c729d348-ce65-4ad0-953a-739b999e79ee]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:44 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:10:44 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:44 devstack sudo[102185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9 Jun 25 17:10:44 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:44 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0" returned: 0 in 1.080s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2290c640-768b-46ab-8517-bbc40e7e47e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] will copy from snapshot at /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Creating direct copy from snapshot {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8f93e5-32f6-4d64-983f-969bbd3d1724]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:10:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:45 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] Acquiring lock "cinder-1427e220-6e4a-4556-82db-4d2b7be96a1c-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:45 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] Lock "cinder-1427e220-6e4a-4556-82db-4d2b7be96a1c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:45 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 Jun 25 17:10:45 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:45 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.042s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:45 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] Acquiring lock "cinder-quobyte-1427e220-6e4a-4556-82db-4d2b7be96a1c" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:10:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:10:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 8 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:10:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:10:45 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] Lock "cinder-quobyte-1427e220-6e4a-4556-82db-4d2b7be96a1c" acquired by "delete_volume" :: waited 0.033s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:45 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[50aae315-5244-469b-972e-28e5405dbd67]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:10:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1427e220-6e4a-4556-82db-4d2b7be96a1c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:45 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9" returned: 0 in 1.277s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:10:45 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1427e220-6e4a-4556-82db-4d2b7be96a1c Jun 25 17:10:45 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:45 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e54ecd7-e1ab-4ce8-9391-2611e6ac5672]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:10:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:45 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 Jun 25 17:10:45 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:46 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5" returned: 0 in 1.183s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:46 devstack cinder-volume[93869]: DEBUG cinder.utils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Path /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ac68cdde-0c0d-46a5-b454-9b537366b5bc not found in is_blk_device check {{(pid=93869) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 17:10:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ac68cdde-0c0d-46a5-b454-9b537366b5bc {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:46 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ac68cdde-0c0d-46a5-b454-9b537366b5bc Jun 25 17:10:46 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:46 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1427e220-6e4a-4556-82db-4d2b7be96a1c" returned: 0 in 0.919s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1427e220-6e4a-4556-82db-4d2b7be96a1c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:46 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1427e220-6e4a-4556-82db-4d2b7be96a1c Jun 25 17:10:46 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:46 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130" returned: 0 in 1.162s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:10:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:46 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9 Jun 25 17:10:46 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:47 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1427e220-6e4a-4556-82db-4d2b7be96a1c" returned: 0 in 0.843s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] Lock "cinder-quobyte-1427e220-6e4a-4556-82db-4d2b7be96a1c" released by "delete_volume" :: held 1.819s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Flow 'volume_create_manager' (6d8ebb21-6f8e-404e-a58a-0e8bae4f93e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b49529-0900-4664-a991-fb3df276d8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79b49529-0900-4664-a991-fb3df276d8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-659451110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c262a17c-1507-48c0-ab35-b8d5710b56bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed13a3b5497417881f23a499440bf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:10:47Z,use_quota=True,user_id='bec3a8704d3643718203ae1439137314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc68941f-75fd-43e3-b17e-f4e408912e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc68941f-75fd-43e3-b17e-f4e408912e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e46746e-0f97-40fb-b906-2a0cbce21e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e46746e-0f97-40fb-b906-2a0cbce21e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c262a17c-1507-48c0-ab35-b8d5710b56bb', 'volume_name': 'volume-c262a17c-1507-48c0-ab35-b8d5710b56bb', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f707f9c-7747-4871-9fdd-304a9e8a3038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f707f9c-7747-4871-9fdd-304a9e8a3038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17db5a29-501f-4308-a044-a22c6621d69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:47 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Volume c262a17c-1507-48c0-ab35-b8d5710b56bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c262a17c-1507-48c0-ab35-b8d5710b56bb', 'volume_size': 1} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] Created reservations ['9e6630b8-aa7d-4a2c-a90a-01a833272e8a', '734200ce-4c14-472a-9f8c-2377962cc98a', 'ca1c162e-aba6-4adc-894b-1e4174ec46b6', 'a5fb73b0-d9d4-4ac3-a3c3-766de4d7f942'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:47 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:10:47 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:48 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9" returned: 0 in 1.986s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:48 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9 Jun 25 17:10:48 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:49 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 2.120s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:49 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:10:49 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] Deleted volume successfully. Jun 25 17:10:49 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7fd99f8b-1f05-492d-b737-1a4e721b2f90 tempest-VolumesTransfersV355Test-771222561 None] Lock "cinder-1427e220-6e4a-4556-82db-4d2b7be96a1c-delete_volume" released by "delete_volume" :: held 4.798s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:50 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.79defe51-0f61-4152-b9a7-b455e02af1a9" returned: 0 in 2.153s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-quobyte-79defe51-0f61-4152-b9a7-b455e02af1a9" released by "_delete_snapshot" :: held 6.831s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-quobyte-1699e2eb-9836-42dc-9e27-fbedb724ec8b" released by "delete_snapshot" :: held 6.882s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:51 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] Created reservations ['4542e065-d5ad-462b-aeeb-bae26be76397', 'b1a7b599-4d31-4759-a048-df77113e2adb', 'e173d306-86a7-47cc-bcbb-85ecfcc6ad95', '7c89745f-f35d-4506-b464-e465d7d27a2d'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:10:51 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] Delete snapshot completed successfully. Jun 25 17:10:51 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dc3d8994-cd8d-4005-b6f0-fcee290e2bd3 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-79defe51-0f61-4152-b9a7-b455e02af1a9-delete_snapshot" released by "delete_snapshot" :: held 7.320s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Acquiring lock "cinder-63cd27f9-700c-4057-910d-9767713ab130-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-63cd27f9-700c-4057-910d-9767713ab130-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Acquiring lock "cinder-quobyte-1699e2eb-9836-42dc-9e27-fbedb724ec8b" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-quobyte-1699e2eb-9836-42dc-9e27-fbedb724ec8b" acquired by "delete_snapshot" :: waited 0.088s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Acquiring lock "cinder-quobyte-63cd27f9-700c-4057-910d-9767713ab130" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-quobyte-63cd27f9-700c-4057-910d-9767713ab130" acquired by "_delete_snapshot" :: waited 0.108s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Deleting offline snapshot 63cd27f9-700c-4057-910d-9767713ab130 of volume 1699e2eb-9836-42dc-9e27-fbedb724ec8b {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:10:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] snapshot_file for this snap is: volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:10:52 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f48b7db-b47f-4d8f-a85f-a8ab7a203848]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:10:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:53 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 Jun 25 17:10:53 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:53 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ac68cdde-0c0d-46a5-b454-9b537366b5bc" returned: 0 in 7.377s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:53 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b37d332-a77e-402b-84fe-acf04892e140]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:10:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:53 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 Jun 25 17:10:53 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:54 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130" returned: 0 in 1.427s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:10:54 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a98742c-3da4-4abd-9d27-23b27f95f9aa]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:10:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:54 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 Jun 25 17:10:54 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:54 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5" returned: 0 in 1.379s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:54 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Image conversion details: src /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5, size 1024.00 MB, duration 7.38 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ac68cdde-0c0d-46a5-b454-9b537366b5bc {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:10:54 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Converted 1024.00 MB image at 138.79 MB/s Jun 25 17:10:54 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ac68cdde-0c0d-46a5-b454-9b537366b5bc is being set with open permissions: ugo+rw: NotImplementedError Jun 25 17:10:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ac68cdde-0c0d-46a5-b454-9b537366b5bc {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:54 devstack sudo[102265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ac68cdde-0c0d-46a5-b454-9b537366b5bc Jun 25 17:10:54 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:55 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399" returned: 0 in 1.085s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:10:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:55 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 Jun 25 17:10:55 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:55 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ac68cdde-0c0d-46a5-b454-9b537366b5bc" returned: 0 in 0.934s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:55 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-ac68cdde-0c0d-46a5-b454-9b537366b5bc" released by "_copy_volume_from_snapshot" :: held 12.109s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:55 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-9b0d7af9-4a6c-4d70-9c46-1c183a310dd0-ac68cdde-0c0d-46a5-b454-9b537366b5bc" released by "_create_volume_from_snapshot" :: held 12.176s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.212s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.529s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-659451110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c262a17c-1507-48c0-ab35-b8d5710b56bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed13a3b5497417881f23a499440bf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:10:47Z,use_quota=True,user_id='bec3a8704d3643718203ae1439137314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:10:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Creating volume c262a17c-1507-48c0-ab35-b8d5710b56bb {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:10:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:10:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:10:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:10:55 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:10:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c262a17c-1507-48c0-ab35-b8d5710b56bb 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:55 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c262a17c-1507-48c0-ab35-b8d5710b56bb 1073741824 Jun 25 17:10:55 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:56 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-48a9f8c1-7c92-4bcf-9d38-14b2a65225ce tempest-GroupSnapshotsTest-1879857753 None] Create group from source-snapshot-47922a51-11b1-4097-9889-0872f95c6e99 completed successfully. Jun 25 17:10:56 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130" returned: 0 in 1.210s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:56 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130 Jun 25 17:10:56 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "cinder-quobyte-ac68cdde-0c0d-46a5-b454-9b537366b5bc" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-ac68cdde-0c0d-46a5-b454-9b537366b5bc" acquired by "delete_volume" :: waited 0.039s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:57 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad97aff2-6786-4382-bbaf-6a4e17652483]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:10:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ac68cdde-0c0d-46a5-b454-9b537366b5bc {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:57 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ac68cdde-0c0d-46a5-b454-9b537366b5bc Jun 25 17:10:57 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:57 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c262a17c-1507-48c0-ab35-b8d5710b56bb 1073741824" returned: 0 in 1.606s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c262a17c-1507-48c0-ab35-b8d5710b56bb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:57 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c262a17c-1507-48c0-ab35-b8d5710b56bb Jun 25 17:10:57 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:57 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.63cd27f9-700c-4057-910d-9767713ab130" returned: 0 in 1.126s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-quobyte-63cd27f9-700c-4057-910d-9767713ab130" released by "_delete_snapshot" :: held 5.099s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-quobyte-1699e2eb-9836-42dc-9e27-fbedb724ec8b" released by "delete_snapshot" :: held 5.221s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:57 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Created reservations ['839ae09f-0e62-475d-be35-616dabf329ff', '9a41433c-5f5e-44a5-9ce1-6ff2bcbfaf7c', '69fdef27-0bd2-4424-b05e-0fa150e4bea3', 'd70bae14-6317-4b43-81be-eb8090d3ca57'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:10:57 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Delete snapshot completed successfully. Jun 25 17:10:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3c558b4c-4800-40e8-9c35-4479769daff7 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-63cd27f9-700c-4057-910d-9767713ab130-delete_snapshot" released by "delete_snapshot" :: held 5.487s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:58 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ac68cdde-0c0d-46a5-b454-9b537366b5bc" returned: 0 in 1.338s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ac68cdde-0c0d-46a5-b454-9b537366b5bc {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:58 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ac68cdde-0c0d-46a5-b454-9b537366b5bc Jun 25 17:10:58 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:58 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c262a17c-1507-48c0-ab35-b8d5710b56bb" returned: 0 in 0.975s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:58 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] <== create_volume: return (2641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:10:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.647s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:58 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17db5a29-501f-4308-a044-a22c6621d69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c262a17c-1507-48c0-ab35-b8d5710b56bb', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:58 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2888b95-3665-48f3-8e5f-2955492fbb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:10:58 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Volume volume-c262a17c-1507-48c0-ab35-b8d5710b56bb (c262a17c-1507-48c0-ab35-b8d5710b56bb): created successfully Jun 25 17:10:58 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2888b95-3665-48f3-8e5f-2955492fbb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:10:58 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Flow 'volume_create_manager' (6d8ebb21-6f8e-404e-a58a-0e8bae4f93e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:10:58 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-ee281206-8f82-4780-8f6b-1b1a14d89ba1 tempest-AttachVolumeNegativeTest-109492441 None] Created volume successfully. Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] Acquiring lock "cinder-ffe19f5f-0a35-4cc5-8ac6-cf3757895399-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-ffe19f5f-0a35-4cc5-8ac6-cf3757895399-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] Acquiring lock "cinder-quobyte-1699e2eb-9836-42dc-9e27-fbedb724ec8b" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-quobyte-1699e2eb-9836-42dc-9e27-fbedb724ec8b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] Acquiring lock "cinder-quobyte-ffe19f5f-0a35-4cc5-8ac6-cf3757895399" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-quobyte-ffe19f5f-0a35-4cc5-8ac6-cf3757895399" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] Deleting offline snapshot ffe19f5f-0a35-4cc5-8ac6-cf3757895399 of volume 1699e2eb-9836-42dc-9e27-fbedb724ec8b {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] snapshot_file for this snap is: volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbb54bd-500c-4dfe-bd28-ba0b7f329292]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:59 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 Jun 25 17:10:59 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:10:59 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ac68cdde-0c0d-46a5-b454-9b537366b5bc" returned: 0 in 1.006s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-ac68cdde-0c0d-46a5-b454-9b537366b5bc" released by "delete_volume" :: held 2.433s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] Created reservations ['d649e5b2-2ce5-446b-9ded-bdfd0c718f85'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:10:59 devstack cinder-volume[93869]: WARNING cinder.quota [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1649981020 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1649981020, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:10:59 devstack cinder-volume[93869]: WARNING cinder.quota [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1649981020 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1649981020, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] Created reservations ['e9c6c941-acf0-459b-93bb-59169cb00704', '7fdbd255-df85-4471-ba05-3e7c8c0b68b4', '3e65d25f-b736-4c51-bf90-f8b26d7d6090', 'd3620686-45ac-43c6-b2a7-ece3dcab9022'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:10:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:10:59 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:10:59 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:00 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399" returned: 0 in 1.243s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:00 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:11:00 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[29edfed3-3259-4165-91bf-84dc5a82aab1]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:11:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:00 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b Jun 25 17:11:00 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:00 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.044s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:00 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:11:00 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-ecff50e3-0224-4f88-b6ec-7ba2ac35c2fa tempest-GroupSnapshotsTest-1879857753 None] Delete group completed successfully. Jun 25 17:11:00 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] group_snapshot 47922a51-11b1-4097-9889-0872f95c6e99: deleting Jun 25 17:11:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] group_snapshot 47922a51-11b1-4097-9889-0872f95c6e99: deleting {{(pid=93869) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 25 17:11:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "cinder-quobyte-2290c640-768b-46ab-8517-bbc40e7e47e5" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:11:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-2290c640-768b-46ab-8517-bbc40e7e47e5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:11:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "cinder-quobyte-9b0d7af9-4a6c-4d70-9c46-1c183a310dd0" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:11:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-9b0d7af9-4a6c-4d70-9c46-1c183a310dd0" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:11:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] Deleting offline snapshot 9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 of volume 2290c640-768b-46ab-8517-bbc40e7e47e5 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:11:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] snapshot_file for this snap is: volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:11:01 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[27469792-5190-4b6f-a7a0-d170dc7338f5]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:11:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:01 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 Jun 25 17:11:01 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:01 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b" returned: 0 in 1.340s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:01 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 Jun 25 17:11:01 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Flow 'volume_create_manager' (070e6223-41a9-4b70-a2ae-f7b24aaec413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79bd757e-cfad-468f-b8cb-d35fdcb348d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79bd757e-cfad-468f-b8cb-d35fdcb348d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1191326223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59209e87-c49d-4db8-af25-5f276f92f28f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c016fe0e55da4d4493352f76d207d441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:11:02Z,use_quota=True,user_id='3f72eb7bfa0840aba4ee59f43e0a25fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077a32a6-a1cb-4ea5-becc-6a415cc212ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077a32a6-a1cb-4ea5-becc-6a415cc212ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7877ed32-0a95-4759-b44e-e796832e2f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7877ed32-0a95-4759-b44e-e796832e2f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59209e87-c49d-4db8-af25-5f276f92f28f', 'volume_name': 'volume-59209e87-c49d-4db8-af25-5f276f92f28f', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2360bc8-7d48-44ae-84b7-d59908e9aebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2360bc8-7d48-44ae-84b7-d59908e9aebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fbeb7e-6700-4227-b373-73be93c29696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:02 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Volume 59209e87-c49d-4db8-af25-5f276f92f28f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59209e87-c49d-4db8-af25-5f276f92f28f', 'volume_size': 1} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1191326223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59209e87-c49d-4db8-af25-5f276f92f28f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c016fe0e55da4d4493352f76d207d441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:11:02Z,use_quota=True,user_id='3f72eb7bfa0840aba4ee59f43e0a25fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Creating volume 59209e87-c49d-4db8-af25-5f276f92f28f {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:11:02 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-59209e87-c49d-4db8-af25-5f276f92f28f 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:02 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0" returned: 0 in 1.528s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2290c640-768b-46ab-8517-bbc40e7e47e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:11:02 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-59209e87-c49d-4db8-af25-5f276f92f28f 1073741824 Jun 25 17:11:02 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5424382-ec3c-47d8-adcb-d8d230f7d60b]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-22351aaf-b27f-46ef-b7be-69fd5dae51df req-73f085f2-ef53-42ae-831a-17136739f43c tempest-AttachVolumeNegativeTest-109492441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:02 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 Jun 25 17:11:02 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:03 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399" returned: 0 in 1.349s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:03 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399 Jun 25 17:11:03 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:04 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-59209e87-c49d-4db8-af25-5f276f92f28f 1073741824" returned: 0 in 1.345s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-59209e87-c49d-4db8-af25-5f276f92f28f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:04 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-59209e87-c49d-4db8-af25-5f276f92f28f Jun 25 17:11:04 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:04 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5" returned: 0 in 1.407s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:04 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 Jun 25 17:11:04 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:04 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b.ffe19f5f-0a35-4cc5-8ac6-cf3757895399" returned: 0 in 1.332s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-quobyte-ffe19f5f-0a35-4cc5-8ac6-cf3757895399" released by "_delete_snapshot" :: held 5.439s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:11:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-quobyte-1699e2eb-9836-42dc-9e27-fbedb724ec8b" released by "delete_snapshot" :: held 5.484s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:11:04 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] Created reservations ['08c2b228-f4dc-47e6-92d6-476fce048fd2', 'f10a36c7-1ec8-4a3f-8e59-ab404f680d24', '15a5577a-bf89-41d8-af75-16652a9d1325', 'eb3c86b7-4bcc-410c-a30d-f84496318d9b'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:11:04 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] Delete snapshot completed successfully. Jun 25 17:11:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eb84fab5-662d-4a4d-bec0-d4ead9c5d90e tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-ffe19f5f-0a35-4cc5-8ac6-cf3757895399-delete_snapshot" released by "delete_snapshot" :: held 5.761s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:11:05 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-59209e87-c49d-4db8-af25-5f276f92f28f" returned: 0 in 0.964s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] <== create_volume: return (2391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:11:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.396s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-22351aaf-b27f-46ef-b7be-69fd5dae51df req-73f085f2-ef53-42ae-831a-17136739f43c tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.281s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fbeb7e-6700-4227-b373-73be93c29696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59209e87-c49d-4db8-af25-5f276f92f28f', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160680dd-1365-444a-9860-61227e3af056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:05 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f788e291-a830-4ee6-882d-99b08e0fffd4]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:11:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-22351aaf-b27f-46ef-b7be-69fd5dae51df req-73f085f2-ef53-42ae-831a-17136739f43c tempest-AttachVolumeNegativeTest-109492441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c262a17c-1507-48c0-ab35-b8d5710b56bb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:05 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Volume volume-59209e87-c49d-4db8-af25-5f276f92f28f (59209e87-c49d-4db8-af25-5f276f92f28f): created successfully Jun 25 17:11:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160680dd-1365-444a-9860-61227e3af056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Flow 'volume_create_manager' (070e6223-41a9-4b70-a2ae-f7b24aaec413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:11:05 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-41c5f1ee-c185-40a6-9361-bc25b76da3ea tempest-VolumesTransfersV357Test-380336424 None] Created volume successfully. Jun 25 17:11:05 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c262a17c-1507-48c0-ab35-b8d5710b56bb Jun 25 17:11:05 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:05 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0" returned: 0 in 1.353s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:05 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0 Jun 25 17:11:05 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] Acquiring lock "cinder-1699e2eb-9836-42dc-9e27-fbedb724ec8b-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:11:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-1699e2eb-9836-42dc-9e27-fbedb724ec8b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:11:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] Acquiring lock "cinder-quobyte-1699e2eb-9836-42dc-9e27-fbedb724ec8b" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:11:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-quobyte-1699e2eb-9836-42dc-9e27-fbedb724ec8b" acquired by "delete_volume" :: waited 0.044s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:11:05 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdadeec-deba-447e-ad46-c2f0f107b0dd]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:11:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:06 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b Jun 25 17:11:06 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:06 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-22351aaf-b27f-46ef-b7be-69fd5dae51df req-73f085f2-ef53-42ae-831a-17136739f43c tempest-AttachVolumeNegativeTest-109492441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c262a17c-1507-48c0-ab35-b8d5710b56bb" returned: 0 in 1.143s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-22351aaf-b27f-46ef-b7be-69fd5dae51df req-73f085f2-ef53-42ae-831a-17136739f43c tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.185s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-22351aaf-b27f-46ef-b7be-69fd5dae51df req-73f085f2-ef53-42ae-831a-17136739f43c tempest-AttachVolumeNegativeTest-109492441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-c262a17c-1507-48c0-ab35-b8d5710b56bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd907a125-c2b9-4060-bdb8-7964e6e4be4f', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:11:06 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-22351aaf-b27f-46ef-b7be-69fd5dae51df req-73f085f2-ef53-42ae-831a-17136739f43c tempest-AttachVolumeNegativeTest-109492441 None] attachment_update completed successfully. Jun 25 17:11:06 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5.9b0d7af9-4a6c-4d70-9c46-1c183a310dd0" returned: 0 in 1.096s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-9b0d7af9-4a6c-4d70-9c46-1c183a310dd0" released by "_delete_snapshot" :: held 5.567s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:11:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-2290c640-768b-46ab-8517-bbc40e7e47e5" released by "delete_snapshot" :: held 5.625s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:11:06 devstack cinder-volume[93869]: WARNING cinder.quota [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1649981020 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1649981020, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:11:06 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] Created reservations ['a7cdb136-aa31-4439-9c89-bce6303bb55e', '10abcec6-768e-4039-aa9d-6f2d4c245207', 'f059559c-f8ae-4063-9c54-e8c7083a655f', 'fc28ebcf-1507-4dd9-83e9-c984e6969f6a'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:11:06 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-27d1693b-5063-4763-8380-8799ecc9b8f9 tempest-VolumesTransfersV357Test-1934584893 None] Transfer volume completed successfully. Jun 25 17:11:07 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-6244d251-9604-4268-ab7a-646e3e84d976 tempest-GroupSnapshotsTest-1879857753 None] group_snapshot 47922a51-11b1-4097-9889-0872f95c6e99: deleted successfully Jun 25 17:11:07 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b" returned: 0 in 1.305s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:07 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b Jun 25 17:11:07 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:08 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1699e2eb-9836-42dc-9e27-fbedb724ec8b" returned: 0 in 0.960s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:08 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] Acquiring lock "cinder-59209e87-c49d-4db8-af25-5f276f92f28f-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:11:08 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-quobyte-1699e2eb-9836-42dc-9e27-fbedb724ec8b" released by "delete_volume" :: held 2.403s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:11:08 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] Lock "cinder-59209e87-c49d-4db8-af25-5f276f92f28f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:11:08 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] Acquiring lock "cinder-quobyte-59209e87-c49d-4db8-af25-5f276f92f28f" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:11:08 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] Created reservations ['73ddb186-6cc6-4695-a363-4e6c4dfbd43f', '7318b7cb-deb1-4931-b0e9-268f3cbc6974', 'caa68cf0-9b58-48c3-9b54-42524d6a0e79', 'eec3b5c3-dcdb-45ad-905a-8a674527bcf4'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:11:08 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] Lock "cinder-quobyte-59209e87-c49d-4db8-af25-5f276f92f28f" acquired by "delete_volume" :: waited 0.033s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:11:08 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[744dd8cc-2d26-4cf6-af74-ccb72d2862e2]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:11:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-59209e87-c49d-4db8-af25-5f276f92f28f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:08 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:11:08 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:11:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:08 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:11:08 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:08 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-59209e87-c49d-4db8-af25-5f276f92f28f Jun 25 17:11:08 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:08 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-cb54d644-8ae7-41a4-99e4-ea28a229f681 tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "cinder-quobyte-2290c640-768b-46ab-8517-bbc40e7e47e5" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:11:08 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-cb54d644-8ae7-41a4-99e4-ea28a229f681 tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-2290c640-768b-46ab-8517-bbc40e7e47e5" acquired by "delete_volume" :: waited 0.026s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:11:08 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4d650b-a5f2-470c-a3cc-6fa93a7da668]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:11:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cb54d644-8ae7-41a4-99e4-ea28a229f681 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:08 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 Jun 25 17:11:08 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:09 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.979s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:09 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:11:09 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] Deleted volume successfully. Jun 25 17:11:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-68c0b518-2f33-4349-9f16-edfe83c4e818 tempest-VolumesSnapshotListTestJSON-1450530106 None] Lock "cinder-1699e2eb-9836-42dc-9e27-fbedb724ec8b-delete_volume" released by "delete_volume" :: held 3.879s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:11:09 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-59209e87-c49d-4db8-af25-5f276f92f28f" returned: 0 in 1.225s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-59209e87-c49d-4db8-af25-5f276f92f28f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:09 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-59209e87-c49d-4db8-af25-5f276f92f28f Jun 25 17:11:09 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:09 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cb54d644-8ae7-41a4-99e4-ea28a229f681 tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5" returned: 0 in 1.152s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cb54d644-8ae7-41a4-99e4-ea28a229f681 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:09 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5 Jun 25 17:11:09 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:10 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-59209e87-c49d-4db8-af25-5f276f92f28f" returned: 0 in 1.056s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] Lock "cinder-quobyte-59209e87-c49d-4db8-af25-5f276f92f28f" released by "delete_volume" :: held 2.362s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:11:10 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] Created reservations ['9c32c48a-002e-4586-b75b-27f62ff188e5', '930709e0-ca33-4c23-b99c-15086440c2a1', 'ca61b380-5c88-4152-b8ff-674464cfdbe3', '1a62519f-b0c6-4f4f-a252-6ae2b6b650fd'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:11:10 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cb54d644-8ae7-41a4-99e4-ea28a229f681 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2290c640-768b-46ab-8517-bbc40e7e47e5" returned: 0 in 0.933s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-cb54d644-8ae7-41a4-99e4-ea28a229f681 tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-2290c640-768b-46ab-8517-bbc40e7e47e5" released by "delete_volume" :: held 2.182s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:11:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:11:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:11:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:10 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-cb54d644-8ae7-41a4-99e4-ea28a229f681 tempest-GroupSnapshotsTest-1879857753 None] Created reservations ['57e082ae-1b03-45f0-a0a5-e35f0960faba'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:11:10 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:11:10 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:10 devstack cinder-volume[93869]: WARNING cinder.db.api [None req-cb54d644-8ae7-41a4-99e4-ea28a229f681 tempest-GroupSnapshotsTest-1879857753 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1649981020'] Jun 25 17:11:10 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-cb54d644-8ae7-41a4-99e4-ea28a229f681 tempest-GroupSnapshotsTest-1879857753 None] Created reservations ['595d421b-b518-4821-bcdb-1b1478b30f8b', '10043c65-6567-4a7d-bf5b-d6d7b5122035', 'dd5f0d75-ef42-4b3b-95d2-5aed5ce82401', '1a334919-ee5f-44a8-b470-ed617a673dfc'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:11:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-cb54d644-8ae7-41a4-99e4-ea28a229f681 tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-cb54d644-8ae7-41a4-99e4-ea28a229f681 tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:11 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-cb54d644-8ae7-41a4-99e4-ea28a229f681 tempest-GroupSnapshotsTest-1879857753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:11:11 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-cb54d644-8ae7-41a4-99e4-ea28a229f681 tempest-GroupSnapshotsTest-1879857753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:11:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-cb54d644-8ae7-41a4-99e4-ea28a229f681 tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cb54d644-8ae7-41a4-99e4-ea28a229f681 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:11 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:11:11 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:11 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.994s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:11 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:11:11 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] Deleted volume successfully. Jun 25 17:11:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f3acf900-468c-4f87-b4a5-667d9663aee9 tempest-VolumesTransfersV357Test-50665259 None] Lock "cinder-59209e87-c49d-4db8-af25-5f276f92f28f-delete_volume" released by "delete_volume" :: held 3.735s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:11:12 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cb54d644-8ae7-41a4-99e4-ea28a229f681 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.072s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-cb54d644-8ae7-41a4-99e4-ea28a229f681 tempest-GroupSnapshotsTest-1879857753 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:11:12 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-cb54d644-8ae7-41a4-99e4-ea28a229f681 tempest-GroupSnapshotsTest-1879857753 None] Delete group completed successfully. Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Flow 'volume_create_manager' (99841497-da27-4240-aebf-3f6d1bef1b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d417d6-df5a-4576-925d-e1417ed63d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d417d6-df5a-4576-925d-e1417ed63d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-309944137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7711fbc7-0d58-49e1-b8db-bc2bd626e6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c016fe0e55da4d4493352f76d207d441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:11:13Z,use_quota=True,user_id='3f72eb7bfa0840aba4ee59f43e0a25fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e87d104-ae34-4b01-839e-a18d3ea2ae0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e87d104-ae34-4b01-839e-a18d3ea2ae0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f14907-87c5-43f4-a5b2-b7bfd33df3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f14907-87c5-43f4-a5b2-b7bfd33df3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7711fbc7-0d58-49e1-b8db-bc2bd626e6c6', 'volume_name': 'volume-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ad36e1-1c98-4cc1-b06f-2e18951b6a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ad36e1-1c98-4cc1-b06f-2e18951b6a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8cac48-765e-45ce-8ab0-03a420328226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:12 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Volume 7711fbc7-0d58-49e1-b8db-bc2bd626e6c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6', 'volume_size': 1} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:11:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-309944137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7711fbc7-0d58-49e1-b8db-bc2bd626e6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c016fe0e55da4d4493352f76d207d441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:11:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:11:13Z,use_quota=True,user_id='3f72eb7bfa0840aba4ee59f43e0a25fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Creating volume 7711fbc7-0d58-49e1-b8db-bc2bd626e6c6 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:11:12 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:11:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:12 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6 1073741824 Jun 25 17:11:12 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:12 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b12e01f0-47c5-4c9a-b7ef-5aff09bf7b13 tempest-GroupSnapshotsTest-1879857753 None] Group tempest-GroupSnapshotsTest-Group-1712041712: creating Jun 25 17:11:12 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b12e01f0-47c5-4c9a-b7ef-5aff09bf7b13 tempest-GroupSnapshotsTest-1879857753 None] Group tempest-GroupSnapshotsTest-Group-1712041712: created successfully Jun 25 17:11:12 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b12e01f0-47c5-4c9a-b7ef-5aff09bf7b13 tempest-GroupSnapshotsTest-1879857753 None] Create group completed successfully. Jun 25 17:11:13 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6 1073741824" returned: 0 in 1.096s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:13 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6 Jun 25 17:11:13 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:13 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-690c1b7e-6ff4-467d-8419-ed3e1eadbb90 req-15d7c182-2d0b-4620-aa05-5a8ef699d7a0 tempest-AttachVolumeNegativeTest-109492441 None] Terminate volume connection completed successfully. Jun 25 17:11:13 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-690c1b7e-6ff4-467d-8419-ed3e1eadbb90 req-15d7c182-2d0b-4620-aa05-5a8ef699d7a0 tempest-AttachVolumeNegativeTest-109492441 None] Deleting attachment d907a125-c2b9-4060-bdb8-7964e6e4be4f. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Flow 'volume_create_manager' (38378ac1-a054-4d72-a477-b988a0401900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bdcbb16-3765-4315-b2b5-e0921a967765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bdcbb16-3765-4315-b2b5-e0921a967765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-335713756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61058828-e294-450c-973d-8950e702ebfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14462e62b59b45e9a3caea264d0ed02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:11:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:11:14Z,use_quota=True,user_id='1191a1af3d5c4757a78a7db36d347191',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e592b41-41e2-4d90-b2f8-1f61596f594f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e592b41-41e2-4d90-b2f8-1f61596f594f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d648ebf-bb15-4969-8b15-86ff475a55b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d648ebf-bb15-4969-8b15-86ff475a55b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61058828-e294-450c-973d-8950e702ebfb', 'volume_name': 'volume-61058828-e294-450c-973d-8950e702ebfb', 'volume_size': 2}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc6c0db-5b91-474d-b5b7-d271e725e8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc6c0db-5b91-474d-b5b7-d271e725e8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2afcdb9-b978-42b2-8371-bb10d906933a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:14 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Volume 61058828-e294-450c-973d-8950e702ebfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61058828-e294-450c-973d-8950e702ebfb', 'volume_size': 2} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:14 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6" returned: 0 in 0.831s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.307s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-335713756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61058828-e294-450c-973d-8950e702ebfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14462e62b59b45e9a3caea264d0ed02d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:11:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:11:14Z,use_quota=True,user_id='1191a1af3d5c4757a78a7db36d347191',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Creating volume 61058828-e294-450c-973d-8950e702ebfb {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:11:14 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb 2147483648 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8cac48-765e-45ce-8ab0-03a420328226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6627bc5c-d825-4bef-9045-e0dd73cb5c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:14 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb 2147483648 Jun 25 17:11:14 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:14 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Volume volume-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6 (7711fbc7-0d58-49e1-b8db-bc2bd626e6c6): created successfully Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6627bc5c-d825-4bef-9045-e0dd73cb5c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Flow 'volume_create_manager' (99841497-da27-4240-aebf-3f6d1bef1b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:11:14 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-95db61fb-2230-4672-8f62-197c2c30df7a tempest-VolumesTransfersV357Test-380336424 None] Created volume successfully. Jun 25 17:11:14 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:11:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Flow 'volume_create_manager' (594c9764-ba20-446b-a0b7-0d8f7238de04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:11:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f15dba-fc66-4794-aa52-1faf9f37ceba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94f15dba-fc66-4794-aa52-1faf9f37ceba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1938830430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0902cc5d-5b1f-45e5-b706-4c3105d6b7e7,host='devstack@QuobyteHD#QuobyteHD',id=44a412a3-3265-4fd5-9884-f1c07612eab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e82e4a1cca242a9a5fff464ca680b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:11:15Z,use_quota=True,user_id='f0bc8da5fe1e4b608a3757b09d0d2fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a98505e2-fd88-4da3-a6ca-8f380548219b),volume_type_id=a98505e2-fd88-4da3-a6ca-8f380548219b)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb8056f-9638-4711-a0f9-ccd2c7208557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb8056f-9638-4711-a0f9-ccd2c7208557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7e08e2-3583-47de-aed0-b4fba1482938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce7e08e2-3583-47de-aed0-b4fba1482938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44a412a3-3265-4fd5-9884-f1c07612eab8', 'volume_name': 'volume-44a412a3-3265-4fd5-9884-f1c07612eab8', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cef3068-3636-434b-a1db-8ebf66f81b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cef3068-3636-434b-a1db-8ebf66f81b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff9f406-17e8-4f59-837a-3463b5eee55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:15 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Volume 44a412a3-3265-4fd5-9884-f1c07612eab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44a412a3-3265-4fd5-9884-f1c07612eab8', 'volume_size': 1} Jun 25 17:11:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:16 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb 2147483648" returned: 0 in 1.316s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:16 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb Jun 25 17:11:16 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:16 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] Acquiring lock "cinder-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:11:16 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] Lock "cinder-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:11:16 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] Acquiring lock "cinder-quobyte-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:11:16 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] Lock "cinder-quobyte-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6" acquired by "delete_volume" :: waited 0.042s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:11:16 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[331ddcac-8485-442e-8e1c-6ec87df82814]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:11:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:16 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6 Jun 25 17:11:16 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:16 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb" returned: 0 in 0.903s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] <== create_volume: return (2273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:11:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.294s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.961s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0902cc5d-5b1f-45e5-b706-4c3105d6b7e7,created_at=2026-06-25T15:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1938830430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0902cc5d-5b1f-45e5-b706-4c3105d6b7e7,host='devstack@QuobyteHD#QuobyteHD',id=44a412a3-3265-4fd5-9884-f1c07612eab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e82e4a1cca242a9a5fff464ca680b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:11:15Z,use_quota=True,user_id='f0bc8da5fe1e4b608a3757b09d0d2fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a98505e2-fd88-4da3-a6ca-8f380548219b),volume_type_id=a98505e2-fd88-4da3-a6ca-8f380548219b)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:11:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Creating volume 44a412a3-3265-4fd5-9884-f1c07612eab8 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:11:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:11:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:11:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:11:17 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:11:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:17 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8 1073741824 Jun 25 17:11:17 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2afcdb9-b978-42b2-8371-bb10d906933a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61058828-e294-450c-973d-8950e702ebfb', 'volume_size': 2}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a983cb-15b3-4a61-a071-35c5071af426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:17 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Volume volume-61058828-e294-450c-973d-8950e702ebfb (61058828-e294-450c-973d-8950e702ebfb): created successfully Jun 25 17:11:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a983cb-15b3-4a61-a071-35c5071af426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Flow 'volume_create_manager' (38378ac1-a054-4d72-a477-b988a0401900) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:11:17 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-cac56213-154f-4e72-a797-a319e905919c tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Created volume successfully. Jun 25 17:11:17 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6" returned: 0 in 1.249s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:17 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6 Jun 25 17:11:17 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0bc05019-47eb-4066-9eb3-ce7b5a528634 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:18 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6" returned: 0 in 1.167s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:18 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] Lock "cinder-quobyte-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6" released by "delete_volume" :: held 2.517s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:11:18 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] Created reservations ['68341e8c-db6e-441e-a9e5-894efc2f1f14', '48d363e3-0727-4636-8216-4e8057d7bba2', '87243c7f-f361-4cf8-932f-c93fda3f0940', '64cdfc0a-d236-4158-89bc-9f8b909d106d'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:11:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:19 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:11:19 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:11:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:19 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8 1073741824" returned: 0 in 2.083s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:19 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:11:19 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:19 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8 Jun 25 17:11:19 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:20 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8" returned: 0 in 1.287s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] <== create_volume: return (3465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:11:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.477s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0bc05019-47eb-4066-9eb3-ce7b5a528634 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.205s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff9f406-17e8-4f59-837a-3463b5eee55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44a412a3-3265-4fd5-9884-f1c07612eab8', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:20 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6928c14a-884e-4cde-961a-7c805bc971d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-0bc05019-47eb-4066-9eb3-ce7b5a528634 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Creating offline snapshot ccd2b1cd-7e7b-44c4-9862-12d5b3547c06 of volume 61058828-e294-450c-973d-8950e702ebfb {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:11:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.496s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:20 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:11:20 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Volume volume-44a412a3-3265-4fd5-9884-f1c07612eab8 (44a412a3-3265-4fd5-9884-f1c07612eab8): created successfully Jun 25 17:11:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6928c14a-884e-4cde-961a-7c805bc971d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Flow 'volume_create_manager' (594c9764-ba20-446b-a0b7-0d8f7238de04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:11:20 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] Deleted volume successfully. Jun 25 17:11:20 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b93e62-f5f3-41b4-8500-1196ea2d887b]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:11:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0bc05019-47eb-4066-9eb3-ce7b5a528634 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:20 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-9741a0e0-e0b4-4924-aa37-2c632af95aa8 tempest-GroupSnapshotsTest-1879857753 None] Created volume successfully. Jun 25 17:11:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9caca1d6-a85b-4c0e-a0fc-4757936ba032 tempest-VolumesTransfersV357Test-50665259 None] Lock "cinder-7711fbc7-0d58-49e1-b8db-bc2bd626e6c6-delete_volume" released by "delete_volume" :: held 4.496s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:11:20 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb Jun 25 17:11:20 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:21 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0bc05019-47eb-4066-9eb3-ce7b5a528634 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb" returned: 0 in 0.898s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0bc05019-47eb-4066-9eb3-ce7b5a528634 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06 2G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:21 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06 2G Jun 25 17:11:21 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:22 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:11:22 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Flow 'volume_create_manager' (0b67087a-7bf7-4938-9ebb-edb877b3febf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:11:22 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ca87c1-fca4-4851-b4b9-2a1c40096357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:22 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ca87c1-fca4-4851-b4b9-2a1c40096357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-656707378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0902cc5d-5b1f-45e5-b706-4c3105d6b7e7,host='devstack@QuobyteHD#QuobyteHD',id=b03bb3ec-c9b1-4a2b-95d4-3682e43006d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e82e4a1cca242a9a5fff464ca680b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:11:23Z,use_quota=True,user_id='f0bc8da5fe1e4b608a3757b09d0d2fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a98505e2-fd88-4da3-a6ca-8f380548219b),volume_type_id=a98505e2-fd88-4da3-a6ca-8f380548219b)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:22 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31fdae29-52e1-43d4-a249-ba990b2df524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:22 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31fdae29-52e1-43d4-a249-ba990b2df524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:22 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47278cd8-0464-4e41-b0e3-cd98db6c0350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:22 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47278cd8-0464-4e41-b0e3-cd98db6c0350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b03bb3ec-c9b1-4a2b-95d4-3682e43006d3', 'volume_name': 'volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:22 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7be3c9-b825-4b2c-9f63-04e29369a2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:22 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7be3c9-b825-4b2c-9f63-04e29369a2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:22 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0794a01-13ae-4a11-a064-d646f46f4ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:22 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Volume b03bb3ec-c9b1-4a2b-95d4-3682e43006d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3', 'volume_size': 1} Jun 25 17:11:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:23 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0bc05019-47eb-4066-9eb3-ce7b5a528634 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06 2G" returned: 0 in 1.421s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0bc05019-47eb-4066-9eb3-ce7b5a528634 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61058828-e294-450c-973d-8950e702ebfb -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:23 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61058828-e294-450c-973d-8950e702ebfb -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06 Jun 25 17:11:23 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:23 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0bc05019-47eb-4066-9eb3-ce7b5a528634 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61058828-e294-450c-973d-8950e702ebfb -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06" returned: 0 in 0.957s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:23 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-0bc05019-47eb-4066-9eb3-ce7b5a528634 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06 is being set with open permissions: ugo+rw Jun 25 17:11:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0bc05019-47eb-4066-9eb3-ce7b5a528634 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:24 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06 Jun 25 17:11:24 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:24 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0bc05019-47eb-4066-9eb3-ce7b5a528634 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06" returned: 0 in 0.756s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0bc05019-47eb-4066-9eb3-ce7b5a528634 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:24 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.info Jun 25 17:11:24 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:25 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0bc05019-47eb-4066-9eb3-ce7b5a528634 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.info" returned: 0 in 0.833s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:25 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-0bc05019-47eb-4066-9eb3-ce7b5a528634 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.info is being set with open permissions: ugo+rw Jun 25 17:11:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0bc05019-47eb-4066-9eb3-ce7b5a528634 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:25 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.info Jun 25 17:11:25 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:26 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0bc05019-47eb-4066-9eb3-ce7b5a528634 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.info" returned: 0 in 0.720s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0bc05019-47eb-4066-9eb3-ce7b5a528634 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.832s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.511s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0902cc5d-5b1f-45e5-b706-4c3105d6b7e7,created_at=2026-06-25T15:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-656707378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0902cc5d-5b1f-45e5-b706-4c3105d6b7e7,host='devstack@QuobyteHD#QuobyteHD',id=b03bb3ec-c9b1-4a2b-95d4-3682e43006d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e82e4a1cca242a9a5fff464ca680b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:11:23Z,use_quota=True,user_id='f0bc8da5fe1e4b608a3757b09d0d2fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a98505e2-fd88-4da3-a6ca-8f380548219b),volume_type_id=a98505e2-fd88-4da3-a6ca-8f380548219b)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:11:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Creating volume b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:11:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:11:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:11:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:11:26 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:11:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:26 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=96,cinder:UPDATE=114,cinder:INSERT=31,cinder:DELETE=11 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:11:26 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 1073741824 Jun 25 17:11:26 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:26 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=119,cinder:SELECT=117,cinder:INSERT=25,cinder:DELETE=4 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:11:26 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-0bc05019-47eb-4066-9eb3-ce7b5a528634 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Create snapshot completed successfully Jun 25 17:11:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Acquiring lock "cinder-ccd2b1cd-7e7b-44c4-9862-12d5b3547c06-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:11:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Lock "cinder-ccd2b1cd-7e7b-44c4-9862-12d5b3547c06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:11:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Acquiring lock "cinder-quobyte-61058828-e294-450c-973d-8950e702ebfb" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:11:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Lock "cinder-quobyte-61058828-e294-450c-973d-8950e702ebfb" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:11:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Acquiring lock "cinder-quobyte-ccd2b1cd-7e7b-44c4-9862-12d5b3547c06" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:11:27 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Lock "cinder-quobyte-ccd2b1cd-7e7b-44c4-9862-12d5b3547c06" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:11:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Deleting offline snapshot ccd2b1cd-7e7b-44c4-9862-12d5b3547c06 of volume 61058828-e294-450c-973d-8950e702ebfb {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:11:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] snapshot_file for this snap is: volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:11:27 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b1d4e1-0d8c-4eb1-97d6-d4624ad75a82]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:11:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:27 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06 Jun 25 17:11:27 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:27 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 1073741824" returned: 0 in 1.370s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:27 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 Jun 25 17:11:27 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:28 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06" returned: 0 in 1.073s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61058828-e294-450c-973d-8950e702ebfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:11:28 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b87f76-27ee-4f2b-9651-94cc94352ca1]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:11:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:28 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb Jun 25 17:11:28 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:28 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3" returned: 0 in 1.116s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] <== create_volume: return (2570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:11:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.575s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0794a01-13ae-4a11-a064-d646f46f4ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48bcd463-7a3e-4187-8a80-47e77ccf2955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:29 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Volume volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 (b03bb3ec-c9b1-4a2b-95d4-3682e43006d3): created successfully Jun 25 17:11:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48bcd463-7a3e-4187-8a80-47e77ccf2955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:29 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Flow 'volume_create_manager' (0b67087a-7bf7-4938-9ebb-edb877b3febf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:11:29 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-bd5ef775-5f9e-4aca-9b94-9e4b15550edc tempest-GroupSnapshotsTest-1879857753 None] Created volume successfully. Jun 25 17:11:29 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb" returned: 0 in 1.353s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:29 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06 Jun 25 17:11:29 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:30 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-56f2b9df-b5d0-4130-9571-d5dc70d0d02d tempest-GroupSnapshotsTest-1879857753 None] Update group completed successfully. Jun 25 17:11:30 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06" returned: 0 in 1.214s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:30 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06 Jun 25 17:11:30 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:31 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb.ccd2b1cd-7e7b-44c4-9862-12d5b3547c06" returned: 0 in 0.948s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:31 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Lock "cinder-quobyte-ccd2b1cd-7e7b-44c4-9862-12d5b3547c06" released by "_delete_snapshot" :: held 4.795s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:11:31 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Lock "cinder-quobyte-61058828-e294-450c-973d-8950e702ebfb" released by "delete_snapshot" :: held 4.835s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:11:32 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Created reservations ['5f7144d5-3998-4484-abb5-c4a4ab3316b5', 'd2ab89ab-68bf-4093-9edb-f92cdabc507e', 'eff28016-6cc5-4868-a45c-e36dc1555b7b', '60f57970-e393-4b7a-b28b-f0d8f27e2aac'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:11:32 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-0d507164-f920-4f3f-b3c9-bad4f6bba44e tempest-GroupSnapshotsTest-1879857753 None] Update group completed successfully. Jun 25 17:11:32 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Delete snapshot completed successfully. Jun 25 17:11:32 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5cbf785b-2a0c-4e75-9ce9-06bcd688eee5 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Lock "cinder-ccd2b1cd-7e7b-44c4-9862-12d5b3547c06-delete_snapshot" released by "delete_snapshot" :: held 5.187s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:11:32 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Acquiring lock "cinder-61058828-e294-450c-973d-8950e702ebfb-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:11:32 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Lock "cinder-61058828-e294-450c-973d-8950e702ebfb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:11:32 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Acquiring lock "cinder-quobyte-61058828-e294-450c-973d-8950e702ebfb" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:11:32 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Lock "cinder-quobyte-61058828-e294-450c-973d-8950e702ebfb" acquired by "delete_volume" :: waited 0.028s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:11:32 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2774c0-7c87-4e18-9d4e-28ea286c6f78]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:11:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:32 devstack sudo[103049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb Jun 25 17:11:32 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:33 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b88235e6-f0a8-4138-b5a7-370c1b4a1c99 tempest-GroupSnapshotsTest-1879857753 None] Update group completed successfully. Jun 25 17:11:33 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb" returned: 0 in 1.174s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:33 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb Jun 25 17:11:33 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:34 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-e16bc0a9-26c4-428b-a884-0fe9652ea881 tempest-GroupSnapshotsTest-1879857753 None] Update group completed successfully. Jun 25 17:11:34 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-61058828-e294-450c-973d-8950e702ebfb" returned: 0 in 0.704s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:34 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Lock "cinder-quobyte-61058828-e294-450c-973d-8950e702ebfb" released by "delete_volume" :: held 2.000s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:11:34 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Created reservations ['fbfca43d-ec3a-4efa-a9c0-2306c364a046', '24edadc8-991f-438c-a5f7-a2f8b8cc3336', 'cb0d84a7-e381-4d77-b616-8bf93e69d54e', '606dbdae-477c-49b9-a9f8-11847dc6bb95'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:11:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:34 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:11:34 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:11:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:35 devstack sudo[103058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:11:35 devstack sudo[103058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:36 devstack sudo[103058]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.355s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:36 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:11:36 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Deleted volume successfully. Jun 25 17:11:36 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1d37e851-26de-4fbd-bdb4-2a50c94e6484 tempest-VolumesSnapshotNegativeTestJSON-1885234639 None] Lock "cinder-61058828-e294-450c-973d-8950e702ebfb-delete_volume" released by "delete_volume" :: held 3.746s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:11:36 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] GroupSnapshot d3be6f44-9a0d-4cb3-b131-9934d254d855: creating. Jun 25 17:11:36 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Group snapshot d3be6f44-9a0d-4cb3-b131-9934d254d855: creating. {{(pid=93869) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 25 17:11:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Creating offline snapshot 0a1b2670-b7cd-4c04-957d-2827ba261760 of volume 44a412a3-3265-4fd5-9884-f1c07612eab8 {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:11:36 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b54a895-3bae-40d9-a10c-2afbcfcc1e3b]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:11:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:36 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8 Jun 25 17:11:36 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:37 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8" returned: 0 in 1.128s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:37 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760 1G Jun 25 17:11:37 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:39 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760 1G" returned: 0 in 1.655s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a412a3-3265-4fd5-9884-f1c07612eab8 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:39 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a412a3-3265-4fd5-9884-f1c07612eab8 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760 Jun 25 17:11:39 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:40 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44a412a3-3265-4fd5-9884-f1c07612eab8 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760" returned: 0 in 0.950s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:40 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760 is being set with open permissions: ugo+rw: NotImplementedError Jun 25 17:11:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:40 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760 Jun 25 17:11:40 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:41 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760" returned: 0 in 0.844s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:41 devstack sudo[103097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.info Jun 25 17:11:41 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:42 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.info" returned: 0 in 1.110s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:42 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.info is being set with open permissions: ugo+rw: NotImplementedError Jun 25 17:11:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:42 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.info Jun 25 17:11:42 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:43 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.info" returned: 0 in 1.190s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.035s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Creating offline snapshot 7ea4dba2-df42-4743-836f-511978232b04 of volume b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:11:43 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa95b16f-c32b-4785-ae2d-6a25b6ad8f7d]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:11:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:43 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 Jun 25 17:11:43 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:11:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:11:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:11:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:44 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:11:44 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:45 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3" returned: 0 in 1.438s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:45 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04 1G Jun 25 17:11:45 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:45 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.127s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:11:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:11:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 8 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:11:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:11:45 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:11:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Flow 'volume_create_manager' (a9355434-7c24-46cf-88de-b3db54b0f789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:11:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d32781b-c130-479d-a7a1-12df94d19fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d32781b-c130-479d-a7a1-12df94d19fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-555681449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3270c4-d236-49d1-8685-b54046aacd56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e82e3ee43540d98e55f43464516bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:11:46Z,use_quota=True,user_id='a8791a8f2f2b47eca9ba26f352568900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdd2c9d-d9ee-4048-919c-1711a9c7e44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdd2c9d-d9ee-4048-919c-1711a9c7e44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f064b49-ed31-4c44-a189-93bf9e34e671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f064b49-ed31-4c44-a189-93bf9e34e671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a3270c4-d236-49d1-8685-b54046aacd56', 'volume_name': 'volume-5a3270c4-d236-49d1-8685-b54046aacd56', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146a6159-44c1-4063-8149-c91597d325a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (146a6159-44c1-4063-8149-c91597d325a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b8f76f-2b28-4208-9e13-7f010cc3d228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:46 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Volume 5a3270c4-d236-49d1-8685-b54046aacd56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a3270c4-d236-49d1-8685-b54046aacd56', 'volume_size': 1} Jun 25 17:11:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:46 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04 1G" returned: 0 in 1.406s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:46 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04 Jun 25 17:11:46 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:47 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04" returned: 0 in 0.909s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:47 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04 is being set with open permissions: ugo+rw: NotImplementedError Jun 25 17:11:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:47 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04 Jun 25 17:11:47 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:48 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04" returned: 0 in 0.800s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:48 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.info Jun 25 17:11:48 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:48 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.info" returned: 0 in 0.735s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:48 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.info is being set with open permissions: ugo+rw: NotImplementedError Jun 25 17:11:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:49 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.info Jun 25 17:11:49 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:49 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.info" returned: 0 in 1.029s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.451s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.943s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:49 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-555681449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a3270c4-d236-49d1-8685-b54046aacd56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6e82e3ee43540d98e55f43464516bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:11:46Z,use_quota=True,user_id='a8791a8f2f2b47eca9ba26f352568900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:11:49 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Creating volume 5a3270c4-d236-49d1-8685-b54046aacd56 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:11:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:11:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:11:49 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:11:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:11:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:11:50 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:11:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:50 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 1073741824 Jun 25 17:11:50 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:50 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-a59d3aea-bc46-4b03-9376-c9dfc92b7746 tempest-GroupSnapshotsTest-1879857753 None] group_snapshot d3be6f44-9a0d-4cb3-b131-9934d254d855: created successfully Jun 25 17:11:50 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] group_snapshot d3be6f44-9a0d-4cb3-b131-9934d254d855: deleting Jun 25 17:11:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] group_snapshot d3be6f44-9a0d-4cb3-b131-9934d254d855: deleting {{(pid=93869) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 25 17:11:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "cinder-quobyte-44a412a3-3265-4fd5-9884-f1c07612eab8" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:11:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-44a412a3-3265-4fd5-9884-f1c07612eab8" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:11:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "cinder-quobyte-0a1b2670-b7cd-4c04-957d-2827ba261760" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:11:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-0a1b2670-b7cd-4c04-957d-2827ba261760" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:11:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Deleting offline snapshot 0a1b2670-b7cd-4c04-957d-2827ba261760 of volume 44a412a3-3265-4fd5-9884-f1c07612eab8 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:11:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] snapshot_file for this snap is: volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:11:51 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b4f41e-8534-4cee-9dbc-92453bd00e1f]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:11:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:51 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760 Jun 25 17:11:51 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:52 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 1073741824" returned: 0 in 2.232s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:52 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 Jun 25 17:11:52 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:52 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760" returned: 0 in 1.972s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:53 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44a412a3-3265-4fd5-9884-f1c07612eab8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:11:53 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f7fdb6-eb36-40f7-8585-ad797b87f845]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:11:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:53 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8 Jun 25 17:11:53 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:54 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56" returned: 0 in 2.127s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] <== create_volume: return (4502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:11:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.509s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:11:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b8f76f-2b28-4208-9e13-7f010cc3d228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a3270c4-d236-49d1-8685-b54046aacd56', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530ca29b-39d0-4c4e-8110-bd0f36caadca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:11:54 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Volume volume-5a3270c4-d236-49d1-8685-b54046aacd56 (5a3270c4-d236-49d1-8685-b54046aacd56): created successfully Jun 25 17:11:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530ca29b-39d0-4c4e-8110-bd0f36caadca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:11:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Flow 'volume_create_manager' (a9355434-7c24-46cf-88de-b3db54b0f789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:11:54 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b6cd2eb5-bc9f-4bb8-8a07-cf4ca1b58b6a tempest-VolumesActionsTest-781711219 None] Created volume successfully. Jun 25 17:11:55 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8" returned: 0 in 2.542s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:55 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760 Jun 25 17:11:55 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:57 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760" returned: 0 in 1.380s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:57 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760 Jun 25 17:11:57 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:57 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8.0a1b2670-b7cd-4c04-957d-2827ba261760" returned: 0 in 0.832s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-0a1b2670-b7cd-4c04-957d-2827ba261760" released by "_delete_snapshot" :: held 7.020s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:11:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-44a412a3-3265-4fd5-9884-f1c07612eab8" released by "delete_snapshot" :: held 7.084s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:11:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "cinder-quobyte-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:11:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:11:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "cinder-quobyte-7ea4dba2-df42-4743-836f-511978232b04" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:11:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-7ea4dba2-df42-4743-836f-511978232b04" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:11:58 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Deleting offline snapshot 7ea4dba2-df42-4743-836f-511978232b04 of volume b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:11:58 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] snapshot_file for this snap is: volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:11:58 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[564622c0-120a-40ba-9160-2f1d6e33d827]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:11:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:58 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04 Jun 25 17:11:58 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:11:59 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Jun 25 17:11:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04" returned: 0 in 0.994s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:11:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:11:59 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bdb2e5-c493-49b8-8052-1e1a95416620]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:11:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:11:59 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 Jun 25 17:11:59 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:00 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3" returned: 0 in 0.999s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:00 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04 Jun 25 17:12:00 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:01 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04" returned: 0 in 1.528s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:01 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04 Jun 25 17:12:01 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:02 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3.7ea4dba2-df42-4743-836f-511978232b04" returned: 0 in 0.870s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-7ea4dba2-df42-4743-836f-511978232b04" released by "_delete_snapshot" :: held 4.565s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:12:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3" released by "delete_snapshot" :: held 4.611s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:12:02 devstack cinder-volume[93869]: WARNING cinder.quota [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-291699898 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-291699898, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:12:02 devstack cinder-volume[93869]: WARNING cinder.quota [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-291699898 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-291699898, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:12:02 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Created reservations ['40f3c4e9-2814-432d-a608-bc5d4973a9fd', 'f14acf3b-ccc2-4c66-aa2a-84abdd374a5d', '2d4ffcb6-cc0b-40cb-a07b-6a3dbf895369', 'b777d61e-471f-419a-b8e4-ca11d957108a'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:12:02 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] Created reservations ['372fb826-ef37-4bde-b4c5-c1d64a26c40a', 'd3c5ce8c-6356-487c-8ce6-5d3a3ce9d081', 'd30bd94a-2b03-4ffe-9a00-6644cf4b179b', 'd6cc32d7-dcf9-453e-a51e-8f8e7923ca77'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:12:03 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-3714220f-c422-4a4d-bb37-ec5cd4420d1f tempest-GroupSnapshotsTest-1879857753 None] group_snapshot d3be6f44-9a0d-4cb3-b131-9934d254d855: deleted successfully Jun 25 17:12:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "cinder-quobyte-44a412a3-3265-4fd5-9884-f1c07612eab8" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:12:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-44a412a3-3265-4fd5-9884-f1c07612eab8" acquired by "delete_volume" :: waited 0.046s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:12:04 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e680a137-f16c-4830-afd7-44a92528ce08]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:12:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:04 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8 Jun 25 17:12:04 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:06 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8" returned: 0 in 1.755s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:06 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8 Jun 25 17:12:06 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:07 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-44a412a3-3265-4fd5-9884-f1c07612eab8" returned: 0 in 1.064s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-44a412a3-3265-4fd5-9884-f1c07612eab8" released by "delete_volume" :: held 2.983s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:12:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "cinder-quobyte-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:12:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3" acquired by "delete_volume" :: waited 0.021s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:12:07 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[235c5400-c175-4be6-9e7f-b9f347cf4174]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:12:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:07 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 Jun 25 17:12:07 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:08 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3" returned: 0 in 0.897s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:08 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3 Jun 25 17:12:08 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:09 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3" returned: 0 in 0.752s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-b03bb3ec-c9b1-4a2b-95d4-3682e43006d3" released by "delete_volume" :: held 1.732s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:12:09 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Created reservations ['0f3c246d-b3a4-4fb2-8e03-1b5676a0e68f'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:12:09 devstack cinder-volume[93869]: WARNING cinder.quota [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-291699898 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-291699898, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:12:09 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Created reservations ['cd51eb7c-ebeb-48e6-8a53-93e4d5c78e00', '5831694a-57d9-4b1d-8c20-64e39021071e', '13963a05-eca5-4eeb-a319-6d1fc0ded5c1', '35b629bd-3c56-4111-b599-804426669378'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:12:09 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Created reservations ['52de62db-2b53-4fa5-bf65-4757fdb59ab7', '7a0e7749-c4d3-4d87-800b-d5860d395431', '02d76acd-c6ee-4c6f-9c8c-5f1f0856e949', '1f35220e-91a8-4ccf-86f2-2dc3e7b52392'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:12:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:12:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:12:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:12:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:12:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:12:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:09 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:12:09 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:10 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-8ca25f5b-9220-4d50-bb1f-7be213f363ca tempest-GroupSnapshotsTest-1879857753 None] Group tempest-GroupSnapshotsTest-Group-82767094: creating Jun 25 17:12:10 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.992s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:10 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:12:10 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-8ca25f5b-9220-4d50-bb1f-7be213f363ca tempest-GroupSnapshotsTest-1879857753 None] Group tempest-GroupSnapshotsTest-Group-82767094: created successfully Jun 25 17:12:10 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-fb6dcd50-b6d9-46fc-8ec8-a21a4d7b3c3f tempest-GroupSnapshotsTest-1879857753 None] Delete group completed successfully. Jun 25 17:12:10 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-8ca25f5b-9220-4d50-bb1f-7be213f363ca tempest-GroupSnapshotsTest-1879857753 None] Create group completed successfully. Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Flow 'volume_create_manager' (0b1c4f84-3ac8-4ad9-818b-0638eb7025af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e52908-04f0-4db5-9d59-564ef5dc3955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79e52908-04f0-4db5-9d59-564ef5dc3955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-212301291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=67e0d3d3-6c0c-46b9-9756-f3694a972a55,host='devstack@QuobyteHD#QuobyteHD',id=d976aa29-edf5-4938-bfa9-7af718cdd5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e82e4a1cca242a9a5fff464ca680b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:12:12Z,use_quota=True,user_id='f0bc8da5fe1e4b608a3757b09d0d2fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23f5897d-d7bb-46a0-9a99-55a54d62b933),volume_type_id=23f5897d-d7bb-46a0-9a99-55a54d62b933)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac52a9ef-959a-4064-905e-23cf6cf610f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac52a9ef-959a-4064-905e-23cf6cf610f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5293c2e6-3fa5-4323-a68b-cb0253c4741a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5293c2e6-3fa5-4323-a68b-cb0253c4741a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd976aa29-edf5-4938-bfa9-7af718cdd5af', 'volume_name': 'volume-d976aa29-edf5-4938-bfa9-7af718cdd5af', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6deb7a-4115-4d67-8182-97aa2bdf3508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6deb7a-4115-4d67-8182-97aa2bdf3508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee80b66-78cf-42d7-8955-d5b11ac07864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:12:12 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Volume d976aa29-edf5-4938-bfa9-7af718cdd5af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d976aa29-edf5-4938-bfa9-7af718cdd5af', 'volume_size': 1} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=67e0d3d3-6c0c-46b9-9756-f3694a972a55,created_at=2026-06-25T15:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-212301291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=67e0d3d3-6c0c-46b9-9756-f3694a972a55,host='devstack@QuobyteHD#QuobyteHD',id=d976aa29-edf5-4938-bfa9-7af718cdd5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e82e4a1cca242a9a5fff464ca680b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:12:12Z,use_quota=True,user_id='f0bc8da5fe1e4b608a3757b09d0d2fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23f5897d-d7bb-46a0-9a99-55a54d62b933),volume_type_id=23f5897d-d7bb-46a0-9a99-55a54d62b933)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Creating volume d976aa29-edf5-4938-bfa9-7af718cdd5af {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:12:12 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:12:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:12 devstack sudo[103357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af 1073741824 Jun 25 17:12:12 devstack sudo[103357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:14 devstack sudo[103357]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af 1073741824" returned: 0 in 1.582s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:14 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af Jun 25 17:12:14 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:15 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af" returned: 0 in 1.300s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] <== create_volume: return (2965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:12:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.969s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:12:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ee80b66-78cf-42d7-8955-d5b11ac07864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d976aa29-edf5-4938-bfa9-7af718cdd5af', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:12:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4e0b5f-6262-43ff-a965-9e7df10329ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:12:15 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Volume volume-d976aa29-edf5-4938-bfa9-7af718cdd5af (d976aa29-edf5-4938-bfa9-7af718cdd5af): created successfully Jun 25 17:12:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4e0b5f-6262-43ff-a965-9e7df10329ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:12:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Flow 'volume_create_manager' (0b1c4f84-3ac8-4ad9-818b-0638eb7025af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:12:15 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-1478ac13-0566-4845-a65a-6dc271fb9785 tempest-GroupSnapshotsTest-1879857753 None] Created volume successfully. Jun 25 17:12:17 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] GroupSnapshot 2055a957-6295-4ffb-865c-020db64c3a10: creating. Jun 25 17:12:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] Group snapshot 2055a957-6295-4ffb-865c-020db64c3a10: creating. {{(pid=93869) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 25 17:12:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:12:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:12:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] Creating offline snapshot adc0a718-2155-4568-87f6-3af805fca0a4 of volume d976aa29-edf5-4938-bfa9-7af718cdd5af {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:12:17 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dfa41e-dcd4-4758-a2fd-5dc52635765b]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:12:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:17 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af Jun 25 17:12:17 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:18 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d83e4443-78ae-4b05-a261-be2fa458b0a0 tempest-VolumesActionsTest-781711219 None] Acquiring lock "cinder-5a3270c4-d236-49d1-8685-b54046aacd56" by "attach_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:12:18 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d83e4443-78ae-4b05-a261-be2fa458b0a0 tempest-VolumesActionsTest-781711219 None] Lock "cinder-5a3270c4-d236-49d1-8685-b54046aacd56" acquired by "attach_volume" :: waited 0.057s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:12:18 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af" returned: 0 in 1.056s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:18 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4 1G Jun 25 17:12:18 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:18 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-d83e4443-78ae-4b05-a261-be2fa458b0a0 tempest-VolumesActionsTest-781711219 None] Attaching volume 5a3270c4-d236-49d1-8685-b54046aacd56 to instance 66c4b593-b644-4c78-aefc-1c7dae8a5745 at mountpoint /dev/vdb on host None. Jun 25 17:12:18 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-d83e4443-78ae-4b05-a261-be2fa458b0a0 tempest-VolumesActionsTest-781711219 None] Attach volume completed successfully. Jun 25 17:12:18 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d83e4443-78ae-4b05-a261-be2fa458b0a0 tempest-VolumesActionsTest-781711219 None] Lock "cinder-5a3270c4-d236-49d1-8685-b54046aacd56" released by "attach_volume" :: held 0.212s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:12:18 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-4141ca53-9f46-4dd5-ad22-4e225ddb8e4f tempest-VolumesActionsTest-781711219 None] Acquiring lock "cinder-5a3270c4-d236-49d1-8685-b54046aacd56-detach_volume" by "detach_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:12:18 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-4141ca53-9f46-4dd5-ad22-4e225ddb8e4f tempest-VolumesActionsTest-781711219 None] Lock "cinder-5a3270c4-d236-49d1-8685-b54046aacd56-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:12:18 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-4141ca53-9f46-4dd5-ad22-4e225ddb8e4f tempest-VolumesActionsTest-781711219 None] Detaching volume 5a3270c4-d236-49d1-8685-b54046aacd56 from instance 66c4b593-b644-4c78-aefc-1c7dae8a5745. Jun 25 17:12:18 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-4141ca53-9f46-4dd5-ad22-4e225ddb8e4f tempest-VolumesActionsTest-781711219 None] Detach volume completed successfully. Jun 25 17:12:19 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-4141ca53-9f46-4dd5-ad22-4e225ddb8e4f tempest-VolumesActionsTest-781711219 None] Lock "cinder-5a3270c4-d236-49d1-8685-b54046aacd56-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:12:19 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4 1G" returned: 0 in 1.339s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d976aa29-edf5-4938-bfa9-7af718cdd5af -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:19 devstack sudo[103463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d976aa29-edf5-4938-bfa9-7af718cdd5af -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4 Jun 25 17:12:19 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:20 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:12:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Flow 'volume_create_manager' (553c4379-cd3f-441c-aec5-c7779dc5e042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:12:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3be570-4b14-400d-b10b-f1d5c29a5961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:12:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3be570-4b14-400d-b10b-f1d5c29a5961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1250358583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec3902a-bf02-4ca5-94e6-685e7f0108d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed13a3b5497417881f23a499440bf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:12:21Z,use_quota=True,user_id='bec3a8704d3643718203ae1439137314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:12:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3d99b8-b40f-4e8e-8cbf-0cbbf24f78dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:12:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed3d99b8-b40f-4e8e-8cbf-0cbbf24f78dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:12:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952aff38-6bba-4eb3-864d-b3905cb84c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:12:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952aff38-6bba-4eb3-864d-b3905cb84c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ec3902a-bf02-4ca5-94e6-685e7f0108d7', 'volume_name': 'volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:12:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be48839-0da8-403b-92c6-3dfa9cf1ba65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:12:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be48839-0da8-403b-92c6-3dfa9cf1ba65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:12:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd8336d-e2fc-4a8c-b71f-096d222e0f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:12:20 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Volume 6ec3902a-bf02-4ca5-94e6-685e7f0108d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7', 'volume_size': 1} Jun 25 17:12:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:12:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d976aa29-edf5-4938-bfa9-7af718cdd5af -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4" returned: 0 in 1.282s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:20 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4 is being set with open permissions: ugo+rw: NotImplementedError Jun 25 17:12:20 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:20 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4 Jun 25 17:12:20 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:21 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4" returned: 0 in 0.914s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:21 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.info Jun 25 17:12:21 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:22 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.info" returned: 0 in 0.935s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:22 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.info is being set with open permissions: ugo+rw: NotImplementedError Jun 25 17:12:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:22 devstack sudo[103532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.info Jun 25 17:12:22 devstack sudo[103532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:23 devstack sudo[103532]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.info" returned: 0 in 1.007s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.666s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:12:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.023s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:12:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1250358583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ec3902a-bf02-4ca5-94e6-685e7f0108d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ed13a3b5497417881f23a499440bf54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:12:21Z,use_quota=True,user_id='bec3a8704d3643718203ae1439137314',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:12:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Creating volume 6ec3902a-bf02-4ca5-94e6-685e7f0108d7 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:12:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:12:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:12:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:12:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:12:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:12:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:12:23 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:12:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:23 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7 1073741824 Jun 25 17:12:23 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:23 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-0dddade8-0c3b-4644-96f8-818df04688b4 tempest-GroupSnapshotsTest-1879857753 None] group_snapshot 2055a957-6295-4ffb-865c-020db64c3a10: created successfully Jun 25 17:12:24 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7 1073741824" returned: 0 in 1.124s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:24 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] group_snapshot 2055a957-6295-4ffb-865c-020db64c3a10: deleting Jun 25 17:12:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:25 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7 Jun 25 17:12:25 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] group_snapshot 2055a957-6295-4ffb-865c-020db64c3a10: deleting {{(pid=93869) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 25 17:12:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "cinder-quobyte-d976aa29-edf5-4938-bfa9-7af718cdd5af" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:12:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-d976aa29-edf5-4938-bfa9-7af718cdd5af" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:12:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "cinder-quobyte-adc0a718-2155-4568-87f6-3af805fca0a4" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:12:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-adc0a718-2155-4568-87f6-3af805fca0a4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:12:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] Deleting offline snapshot adc0a718-2155-4568-87f6-3af805fca0a4 of volume d976aa29-edf5-4938-bfa9-7af718cdd5af {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:12:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] snapshot_file for this snap is: volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:12:25 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f814a7c-fa2c-4028-b1e0-12c12cd53354]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:12:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:25 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4 Jun 25 17:12:25 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:25 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7" returned: 0 in 0.918s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:12:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:12:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd8336d-e2fc-4a8c-b71f-096d222e0f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:12:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36da336e-57dd-4735-8865-2858be54404a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:12:26 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Volume volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7 (6ec3902a-bf02-4ca5-94e6-685e7f0108d7): created successfully Jun 25 17:12:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36da336e-57dd-4735-8865-2858be54404a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:12:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Flow 'volume_create_manager' (553c4379-cd3f-441c-aec5-c7779dc5e042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:12:26 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-372ba4c0-fe70-4c6e-95f6-b99eed556370 tempest-AttachVolumeNegativeTest-109492441 None] Created volume successfully. Jun 25 17:12:26 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4" returned: 0 in 1.048s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d976aa29-edf5-4938-bfa9-7af718cdd5af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:12:26 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fa314b-6e06-47df-a232-8f187b9f6bed]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:12:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:26 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af Jun 25 17:12:26 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:27 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af" returned: 0 in 1.067s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:27 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4 Jun 25 17:12:27 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:28 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4" returned: 0 in 1.036s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:28 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4 Jun 25 17:12:28 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:29 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af.adc0a718-2155-4568-87f6-3af805fca0a4" returned: 0 in 0.724s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:29 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-adc0a718-2155-4568-87f6-3af805fca0a4" released by "_delete_snapshot" :: held 4.011s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:12:29 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-d976aa29-edf5-4938-bfa9-7af718cdd5af" released by "delete_snapshot" :: held 4.039s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:12:29 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:DELETE=4,cinder:SELECT=73,cinder:UPDATE=75,cinder:INSERT=16 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:12:29 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=65,cinder:INSERT=18,cinder:DELETE=2,cinder:SELECT=76 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:12:29 devstack cinder-volume[93869]: WARNING cinder.quota [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2032462081 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2032462081, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:12:29 devstack cinder-volume[93869]: WARNING cinder.quota [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2032462081 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2032462081, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:12:29 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] Created reservations ['366925f0-e4d2-4363-9e9a-83a3259b3cde', '09f8f9c4-a5d1-4e22-9b51-84052419dd67', '22297e45-9f42-4bbd-893a-192ff27b8e8f', '07e428f1-c087-4f73-bf22-3a8aba6f16a9'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:12:29 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-cfc86f48-5ab7-4c47-b0ac-1a17df31e66e tempest-GroupSnapshotsTest-1879857753 None] group_snapshot 2055a957-6295-4ffb-865c-020db64c3a10: deleted successfully Jun 25 17:12:29 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-2d827908-973a-4255-a10a-bb78b5a28cea tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "cinder-quobyte-d976aa29-edf5-4938-bfa9-7af718cdd5af" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:12:29 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-2d827908-973a-4255-a10a-bb78b5a28cea tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-d976aa29-edf5-4938-bfa9-7af718cdd5af" acquired by "delete_volume" :: waited 0.015s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:12:29 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa414fa-cc95-4d3e-8744-b2bb74892102]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:12:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2d827908-973a-4255-a10a-bb78b5a28cea tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:30 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af Jun 25 17:12:30 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-75bae0aa-a52b-439c-a4ca-80112e37a6fe req-7ce36656-06b4-4a12-ad93-a76caeb17906 tempest-AttachVolumeNegativeTest-109492441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:12:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-75bae0aa-a52b-439c-a4ca-80112e37a6fe req-7ce36656-06b4-4a12-ad93-a76caeb17906 tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:12:30 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f95c94-4236-4551-a031-09467e4774f5]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:12:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-75bae0aa-a52b-439c-a4ca-80112e37a6fe req-7ce36656-06b4-4a12-ad93-a76caeb17906 tempest-AttachVolumeNegativeTest-109492441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:30 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7 Jun 25 17:12:30 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:30 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2d827908-973a-4255-a10a-bb78b5a28cea tempest-GroupSnapshotsTest-1879857753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af" returned: 0 in 0.934s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2d827908-973a-4255-a10a-bb78b5a28cea tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:30 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af Jun 25 17:12:30 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:31 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-75bae0aa-a52b-439c-a4ca-80112e37a6fe req-7ce36656-06b4-4a12-ad93-a76caeb17906 tempest-AttachVolumeNegativeTest-109492441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7" returned: 0 in 0.921s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-75bae0aa-a52b-439c-a4ca-80112e37a6fe req-7ce36656-06b4-4a12-ad93-a76caeb17906 tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.947s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:12:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-75bae0aa-a52b-439c-a4ca-80112e37a6fe req-7ce36656-06b4-4a12-ad93-a76caeb17906 tempest-AttachVolumeNegativeTest-109492441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00c2b826-9de3-4302-82cd-350a30622ac4', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:12:31 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-75bae0aa-a52b-439c-a4ca-80112e37a6fe req-7ce36656-06b4-4a12-ad93-a76caeb17906 tempest-AttachVolumeNegativeTest-109492441 None] attachment_update completed successfully. Jun 25 17:12:31 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2d827908-973a-4255-a10a-bb78b5a28cea tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d976aa29-edf5-4938-bfa9-7af718cdd5af" returned: 0 in 0.755s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:31 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-2d827908-973a-4255-a10a-bb78b5a28cea tempest-GroupSnapshotsTest-1879857753 None] Lock "cinder-quobyte-d976aa29-edf5-4938-bfa9-7af718cdd5af" released by "delete_volume" :: held 1.768s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:12:31 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-2d827908-973a-4255-a10a-bb78b5a28cea tempest-GroupSnapshotsTest-1879857753 None] Created reservations ['b8359da2-40dd-41a2-925e-f0cb47a4c667'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:12:31 devstack cinder-volume[93869]: WARNING cinder.quota [None req-2d827908-973a-4255-a10a-bb78b5a28cea tempest-GroupSnapshotsTest-1879857753 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2032462081 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2032462081, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:12:31 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-2d827908-973a-4255-a10a-bb78b5a28cea tempest-GroupSnapshotsTest-1879857753 None] Created reservations ['77993b15-f1f5-44e2-b1e7-dfb48e1e360d', '45d7bc4b-0e47-4d4b-863f-a2c29191550f', '5951135f-8588-4ac8-8a2c-cdea8a6e49ad', 'a5194b48-3314-4dc5-9cfc-e72ff997a7d4'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:12:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2d827908-973a-4255-a10a-bb78b5a28cea tempest-GroupSnapshotsTest-1879857753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:12:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2d827908-973a-4255-a10a-bb78b5a28cea tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:12:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2d827908-973a-4255-a10a-bb78b5a28cea tempest-GroupSnapshotsTest-1879857753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:12:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2d827908-973a-4255-a10a-bb78b5a28cea tempest-GroupSnapshotsTest-1879857753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:12:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2d827908-973a-4255-a10a-bb78b5a28cea tempest-GroupSnapshotsTest-1879857753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:12:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2d827908-973a-4255-a10a-bb78b5a28cea tempest-GroupSnapshotsTest-1879857753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:31 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:12:31 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:32 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2d827908-973a-4255-a10a-bb78b5a28cea tempest-GroupSnapshotsTest-1879857753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.805s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:32 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-2d827908-973a-4255-a10a-bb78b5a28cea tempest-GroupSnapshotsTest-1879857753 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:12:32 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-2d827908-973a-4255-a10a-bb78b5a28cea tempest-GroupSnapshotsTest-1879857753 None] Delete group completed successfully. Jun 25 17:12:41 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=17,cinder:INSERT=6,cinder:UPDATE=16 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:12:41 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=20,cinder:INSERT=3,cinder:UPDATE=20 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:12:44 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-37beb1bf-17e3-4c4d-bd3a-1a7fc0912a28 req-e01fbe4c-3f3d-49b2-ab04-28a4491853fc tempest-AttachVolumeNegativeTest-109492441 None] Terminate volume connection completed successfully. Jun 25 17:12:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-37beb1bf-17e3-4c4d-bd3a-1a7fc0912a28 req-e01fbe4c-3f3d-49b2-ab04-28a4491853fc tempest-AttachVolumeNegativeTest-109492441 None] Deleting attachment 00c2b826-9de3-4302-82cd-350a30622ac4. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:12:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:12:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:12:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:12:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:12:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:12:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:12:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:12:44 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:12:44 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:12:45 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Jun 25 17:12:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.905s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:12:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:12:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:12:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 8 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:12:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:12:55 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:12:55 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:12:56 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-962003ae-5cfa-41c9-b745-70833c62dc56 tempest-VolumesActionsTest-781711219 None] Acquiring lock "cinder-5a3270c4-d236-49d1-8685-b54046aacd56" by "attach_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:12:56 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-962003ae-5cfa-41c9-b745-70833c62dc56 tempest-VolumesActionsTest-781711219 None] Lock "cinder-5a3270c4-d236-49d1-8685-b54046aacd56" acquired by "attach_volume" :: waited 0.040s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:12:56 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-962003ae-5cfa-41c9-b745-70833c62dc56 tempest-VolumesActionsTest-781711219 None] Attaching volume 5a3270c4-d236-49d1-8685-b54046aacd56 to instance c58c2117-1e8d-4348-9bc1-763f0b0d6d63 at mountpoint /dev/vdb on host None. Jun 25 17:12:57 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-962003ae-5cfa-41c9-b745-70833c62dc56 tempest-VolumesActionsTest-781711219 None] Attach volume completed successfully. Jun 25 17:12:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-962003ae-5cfa-41c9-b745-70833c62dc56 tempest-VolumesActionsTest-781711219 None] Lock "cinder-5a3270c4-d236-49d1-8685-b54046aacd56" released by "attach_volume" :: held 0.166s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:12:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1dbe32a2-7512-436f-beb8-78d1280e3f87 tempest-VolumesActionsTest-781711219 None] Acquiring lock "cinder-5a3270c4-d236-49d1-8685-b54046aacd56-detach_volume" by "detach_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:12:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1dbe32a2-7512-436f-beb8-78d1280e3f87 tempest-VolumesActionsTest-781711219 None] Lock "cinder-5a3270c4-d236-49d1-8685-b54046aacd56-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:12:57 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-1dbe32a2-7512-436f-beb8-78d1280e3f87 tempest-VolumesActionsTest-781711219 None] Detaching volume 5a3270c4-d236-49d1-8685-b54046aacd56 from instance c58c2117-1e8d-4348-9bc1-763f0b0d6d63. Jun 25 17:12:58 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-1dbe32a2-7512-436f-beb8-78d1280e3f87 tempest-VolumesActionsTest-781711219 None] Detach volume completed successfully. Jun 25 17:12:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1dbe32a2-7512-436f-beb8-78d1280e3f87 tempest-VolumesActionsTest-781711219 None] Lock "cinder-5a3270c4-d236-49d1-8685-b54046aacd56-detach_volume" released by "detach_volume" :: held 0.193s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:13:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] Acquiring lock "cinder-6ec3902a-bf02-4ca5-94e6-685e7f0108d7-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:13:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] Lock "cinder-6ec3902a-bf02-4ca5-94e6-685e7f0108d7-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:13:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] Acquiring lock "cinder-quobyte-6ec3902a-bf02-4ca5-94e6-685e7f0108d7" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:13:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] Lock "cinder-quobyte-6ec3902a-bf02-4ca5-94e6-685e7f0108d7" acquired by "delete_volume" :: waited 0.051s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:13:01 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[793e5a8f-3ebb-4833-98f0-a4e8252958b3]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:13:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:01 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7 Jun 25 17:13:01 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:02 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7" returned: 0 in 1.223s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:03 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7 Jun 25 17:13:03 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:03 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ec3902a-bf02-4ca5-94e6-685e7f0108d7" returned: 0 in 0.746s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] Lock "cinder-quobyte-6ec3902a-bf02-4ca5-94e6-685e7f0108d7" released by "delete_volume" :: held 2.100s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:13:03 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] Created reservations ['0fe0dadd-bfb3-42ab-91ec-c5a1395e29d3', 'b5d0bcc9-de12-4fcb-8534-aad3a69eb49b', '8e25562f-f693-480d-9dde-5c8de4414cbb', 'cd0823f9-0ef6-4a0f-bb6e-eee5a470356a'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:13:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:13:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:13:03 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:13:03 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:13:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:13:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:03 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:13:03 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Flow 'volume_create_manager' (cd4a38c9-3bb3-420c-9538-b2ef7b42d39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:13:04 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c83569-a6ec-4835-bf9a-cccebca870ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.729s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:13:04 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] Deleted volume successfully. Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c83569-a6ec-4835-bf9a-cccebca870ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-943975652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed65bfd-d539-4865-a314-1f4826103cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd24b811aa184c8fbddd09a951dc813a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:13:05Z,use_quota=True,user_id='8b7cc592a4534e6cbe6a675e86ea8119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8acaffa1-81c3-478e-9cc8-b88edefbc6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8acaffa1-81c3-478e-9cc8-b88edefbc6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ccf6a37-e26d-4204-a79e-791c4e338f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ccf6a37-e26d-4204-a79e-791c4e338f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ed65bfd-d539-4865-a314-1f4826103cb8', 'volume_name': 'volume-4ed65bfd-d539-4865-a314-1f4826103cb8', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec0db82-872f-45a4-bc07-b28e40e9bfe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec0db82-872f-45a4-bc07-b28e40e9bfe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e01223f-6237-4b59-a247-58bfc3558ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:04 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Volume 4ed65bfd-d539-4865-a314-1f4826103cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ed65bfd-d539-4865-a314-1f4826103cb8', 'volume_size': 1} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-943975652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ed65bfd-d539-4865-a314-1f4826103cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd24b811aa184c8fbddd09a951dc813a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:13:05Z,use_quota=True,user_id='8b7cc592a4534e6cbe6a675e86ea8119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Creating volume 4ed65bfd-d539-4865-a314-1f4826103cb8 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:13:04 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4ed65bfd-d539-4865-a314-1f4826103cb8 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:04 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4ed65bfd-d539-4865-a314-1f4826103cb8 1073741824 Jun 25 17:13:04 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d06e4269-cba7-49af-be62-0a3313b41cb1 tempest-AttachVolumeNegativeTest-109492441 None] Lock "cinder-6ec3902a-bf02-4ca5-94e6-685e7f0108d7-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:13:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] Acquiring lock "cinder-c262a17c-1507-48c0-ab35-b8d5710b56bb-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:13:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] Lock "cinder-c262a17c-1507-48c0-ab35-b8d5710b56bb-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:13:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] Acquiring lock "cinder-quobyte-c262a17c-1507-48c0-ab35-b8d5710b56bb" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:13:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] Lock "cinder-quobyte-c262a17c-1507-48c0-ab35-b8d5710b56bb" acquired by "delete_volume" :: waited 0.018s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:13:05 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[14517ab0-801b-43da-a6eb-88753118d2c9]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:13:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c262a17c-1507-48c0-ab35-b8d5710b56bb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:05 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c262a17c-1507-48c0-ab35-b8d5710b56bb Jun 25 17:13:05 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:05 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4ed65bfd-d539-4865-a314-1f4826103cb8 1073741824" returned: 0 in 1.143s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4ed65bfd-d539-4865-a314-1f4826103cb8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:05 devstack sudo[104433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4ed65bfd-d539-4865-a314-1f4826103cb8 Jun 25 17:13:05 devstack sudo[104433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:06 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c262a17c-1507-48c0-ab35-b8d5710b56bb" returned: 0 in 1.015s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c262a17c-1507-48c0-ab35-b8d5710b56bb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:06 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c262a17c-1507-48c0-ab35-b8d5710b56bb Jun 25 17:13:06 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:06 devstack sudo[104433]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4ed65bfd-d539-4865-a314-1f4826103cb8" returned: 0 in 0.881s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:13:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:13:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e01223f-6237-4b59-a247-58bfc3558ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed65bfd-d539-4865-a314-1f4826103cb8', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81df4e9e-b132-4b97-b5a3-85e7d2a9ccc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:06 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Volume volume-4ed65bfd-d539-4865-a314-1f4826103cb8 (4ed65bfd-d539-4865-a314-1f4826103cb8): created successfully Jun 25 17:13:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81df4e9e-b132-4b97-b5a3-85e7d2a9ccc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Flow 'volume_create_manager' (cd4a38c9-3bb3-420c-9538-b2ef7b42d39f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:13:06 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-48e66cf9-8273-4d87-8b5f-fd08844a30b7 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Created volume successfully. Jun 25 17:13:06 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c262a17c-1507-48c0-ab35-b8d5710b56bb" returned: 0 in 0.813s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] Lock "cinder-quobyte-c262a17c-1507-48c0-ab35-b8d5710b56bb" released by "delete_volume" :: held 1.886s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:13:07 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] Created reservations ['4eb196e7-e62b-4d84-8c66-02195b6c34b6', '927eb1df-4457-4ad9-9522-235cd3d9c073', '95fb999f-3515-4f04-b70f-7ce893dc6c56', '544a719a-f79c-424a-bb45-237123e47c8c'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:13:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:13:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:13:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:13:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:13:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:13:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:07 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:13:07 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] Acquiring lock "cinder-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:13:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] Lock "cinder-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:13:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] Acquiring lock "cinder-quobyte-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:13:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] Lock "cinder-quobyte-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99" acquired by "delete_volume" :: waited 0.032s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:13:07 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c23756-d822-4a45-8b5a-185b3d4b5f57]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:13:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:07 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99 Jun 25 17:13:07 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:08 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.904s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:08 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:13:08 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] Deleted volume successfully. Jun 25 17:13:08 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8c9bc6bf-0161-4b9a-8369-260ee8bd14cf tempest-AttachVolumeNegativeTest-109492441 None] Lock "cinder-c262a17c-1507-48c0-ab35-b8d5710b56bb-delete_volume" released by "delete_volume" :: held 3.062s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:13:08 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99" returned: 0 in 1.151s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:08 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99 Jun 25 17:13:08 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f5e3bf43-f8b5-4d7e-88fe-3dae17dfd80d tempest-VolumesActionsTest-781711219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:13:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f5e3bf43-f8b5-4d7e-88fe-3dae17dfd80d tempest-VolumesActionsTest-781711219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:13:09 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93c5f06-6c2d-4fff-901d-5109c9651303]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:13:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f5e3bf43-f8b5-4d7e-88fe-3dae17dfd80d tempest-VolumesActionsTest-781711219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Acquiring lock "cinder-4ed65bfd-d539-4865-a314-1f4826103cb8-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:13:09 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 Jun 25 17:13:09 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Lock "cinder-4ed65bfd-d539-4865-a314-1f4826103cb8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:13:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Acquiring lock "cinder-quobyte-4ed65bfd-d539-4865-a314-1f4826103cb8" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:13:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Lock "cinder-quobyte-4ed65bfd-d539-4865-a314-1f4826103cb8" acquired by "delete_volume" :: waited 0.014s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:13:09 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[65289d30-7fc1-4933-ad83-aeb82e070281]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:13:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4ed65bfd-d539-4865-a314-1f4826103cb8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:09 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4ed65bfd-d539-4865-a314-1f4826103cb8 Jun 25 17:13:09 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:09 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99" returned: 0 in 0.868s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] Lock "cinder-quobyte-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99" released by "delete_volume" :: held 2.080s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:13:09 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f5e3bf43-f8b5-4d7e-88fe-3dae17dfd80d tempest-VolumesActionsTest-781711219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56" returned: 0 in 0.808s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:09 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] Created reservations ['81bcbebd-a6d6-4d0f-9786-bb11d3f7ad6c', 'e7218daa-233c-4bef-ad90-fede4d6b6c21', '04e527d7-7db9-4be0-ad6c-2e27e9a0f4c5', '8e734e1b-a1c7-442e-951f-f1a20c031f9d'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:13:09 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55a92b2-f79f-471f-bdc5-53b86d78d5fb]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:13:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f5e3bf43-f8b5-4d7e-88fe-3dae17dfd80d tempest-VolumesActionsTest-781711219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:13:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:13:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:13:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:13:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:13:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:10 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 Jun 25 17:13:10 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:10 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:13:10 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:10 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4ed65bfd-d539-4865-a314-1f4826103cb8" returned: 0 in 0.868s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4ed65bfd-d539-4865-a314-1f4826103cb8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:10 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4ed65bfd-d539-4865-a314-1f4826103cb8 Jun 25 17:13:10 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:10 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.703s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:10 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:13:10 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] Deleted volume successfully. Jun 25 17:13:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b2aec8c0-8eb3-4611-876b-eb5757017baf tempest-AttachVolumeNegativeTest-109492441 None] Lock "cinder-5cb4cbb5-1b4d-4432-bd00-3cb2cbf47e99-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:13:10 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4ed65bfd-d539-4865-a314-1f4826103cb8" returned: 0 in 0.702s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Lock "cinder-quobyte-4ed65bfd-d539-4865-a314-1f4826103cb8" released by "delete_volume" :: held 1.618s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:13:10 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Created reservations ['5f637890-8967-4960-b209-7584ce9da05c', '2354224b-5a86-4d20-8029-55b58c2f0702', '07eb04a6-1655-464a-8500-12943d9f3fee', '2d9b67c1-fd07-4d75-8250-225fc6e3594d'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:13:11 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f5e3bf43-f8b5-4d7e-88fe-3dae17dfd80d tempest-VolumesActionsTest-781711219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56" returned: 0 in 1.118s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f5e3bf43-f8b5-4d7e-88fe-3dae17dfd80d tempest-VolumesActionsTest-781711219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 /opt/stack/data/cinder/conversion/5a3270c4-d236-49d1-8685-b54046aacd56.temp_image.bf35dbe4-1a85-412c-b398-d0561d4b628cu9sfe47t.img {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:13:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:13:11 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:13:11 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 /opt/stack/data/cinder/conversion/5a3270c4-d236-49d1-8685-b54046aacd56.temp_image.bf35dbe4-1a85-412c-b398-d0561d4b628cu9sfe47t.img Jun 25 17:13:11 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:13:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:13:11 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:11 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:13:11 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:12 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.442s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:12 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:13:12 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Deleted volume successfully. Jun 25 17:13:12 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f6d3f39a-81a5-4e43-932b-92d9c025dde1 tempest-VolumeQuotasNegativeTestJSON-2048254094 None] Lock "cinder-4ed65bfd-d539-4865-a314-1f4826103cb8-delete_volume" released by "delete_volume" :: held 3.449s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:13:17 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f5e3bf43-f8b5-4d7e-88fe-3dae17dfd80d tempest-VolumesActionsTest-781711219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 /opt/stack/data/cinder/conversion/5a3270c4-d236-49d1-8685-b54046aacd56.temp_image.bf35dbe4-1a85-412c-b398-d0561d4b628cu9sfe47t.img" returned: 0 in 6.950s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:18 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[22397feb-6b94-493c-bbec-59d9e9afc9be]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:13:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f5e3bf43-f8b5-4d7e-88fe-3dae17dfd80d tempest-VolumesActionsTest-781711219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:18 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 Jun 25 17:13:18 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:19 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:13:19 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Flow 'volume_create_manager' (047fe167-5695-4b9d-befc-4c3d43b89db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:13:19 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a7a5c19-2da3-4ec7-b3a6-3468a25543c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:19 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a7a5c19-2da3-4ec7-b3a6-3468a25543c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1567338023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df114ee-7cc5-419e-828c-4fa54ea83320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4ec6661500494484f79981dd315db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:13:19Z,use_quota=True,user_id='2ab20ada88654388a4944dea9b1ecef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:19 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491f1be0-45f0-4bba-bae4-0d52c865a288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:19 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (491f1be0-45f0-4bba-bae4-0d52c865a288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:19 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3b50ed-351c-4360-ba6f-71c93257f141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:19 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3b50ed-351c-4360-ba6f-71c93257f141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7df114ee-7cc5-419e-828c-4fa54ea83320', 'volume_name': 'volume-7df114ee-7cc5-419e-828c-4fa54ea83320', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:19 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8563a15-7df2-4278-af6d-e30f1f9692f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:19 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8563a15-7df2-4278-af6d-e30f1f9692f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:19 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dbc7a15-5d62-4c7c-9399-bd5ff86033ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:19 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Volume 7df114ee-7cc5-419e-828c-4fa54ea83320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7df114ee-7cc5-419e-828c-4fa54ea83320', 'volume_size': 1} Jun 25 17:13:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:13:19 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f5e3bf43-f8b5-4d7e-88fe-3dae17dfd80d tempest-VolumesActionsTest-781711219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56" returned: 0 in 1.481s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:19 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-f5e3bf43-f8b5-4d7e-88fe-3dae17dfd80d tempest-VolumesActionsTest-781711219 None] Image conversion details: src /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56, size 1024.00 MB, duration 6.95 sec, destination /opt/stack/data/cinder/conversion/5a3270c4-d236-49d1-8685-b54046aacd56.temp_image.bf35dbe4-1a85-412c-b398-d0561d4b628cu9sfe47t.img {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:13:19 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-f5e3bf43-f8b5-4d7e-88fe-3dae17dfd80d tempest-VolumesActionsTest-781711219 None] Converted 1024.00 MB image at 147.31 MB/s Jun 25 17:13:19 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-f5e3bf43-f8b5-4d7e-88fe-3dae17dfd80d tempest-VolumesActionsTest-781711219 None] bf35dbe4-1a85-412c-b398-d0561d4b628c was raw, no need to convert to raw {{(pid=93869) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 25 17:13:26 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:13:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Flow 'volume_create_manager' (7e6ff0e2-f885-4e52-bf45-c0e329479e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:13:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fec3751-0427-4f9d-8abd-2c633d298e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fec3751-0427-4f9d-8abd-2c633d298e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-237363364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05a6d8c-37c0-47bd-af05-77c4eca51289,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d585cad7822243cb886f7bc409499374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:13:27Z,use_quota=True,user_id='22ee1304dd364228aa79289dbb34f4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eda7a23-1fe3-448e-a5b5-4cac48e4675e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eda7a23-1fe3-448e-a5b5-4cac48e4675e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d79ddb5-7459-4e7d-a201-3fc953102256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d79ddb5-7459-4e7d-a201-3fc953102256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a05a6d8c-37c0-47bd-af05-77c4eca51289', 'volume_name': 'volume-a05a6d8c-37c0-47bd-af05-77c4eca51289', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde5e5e0-06f9-4463-beb7-173913403bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde5e5e0-06f9-4463-beb7-173913403bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93db891-a18a-4ebe-b9ef-68047008d96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:27 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Volume a05a6d8c-37c0-47bd-af05-77c4eca51289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a05a6d8c-37c0-47bd-af05-77c4eca51289', 'volume_size': 1} Jun 25 17:13:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:13:32 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:13:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Flow 'volume_create_manager' (d89385e4-9a90-4d6a-b6fd-843110a1189c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:13:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa812b9-13a4-4049-a40b-6c0b69691076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa812b9-13a4-4049-a40b-6c0b69691076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-723928264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403e7739-c2d1-42db-8c03-22e304181545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30834beaa9dc4100813bdc384829d424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:13:32Z,use_quota=True,user_id='2b54b4203ea74049a8049300458a3d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa751ba-653b-45c7-9901-af140e415fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa751ba-653b-45c7-9901-af140e415fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f882cd8a-408c-4c11-a8a6-848b5f9f5fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f882cd8a-408c-4c11-a8a6-848b5f9f5fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '403e7739-c2d1-42db-8c03-22e304181545', 'volume_name': 'volume-403e7739-c2d1-42db-8c03-22e304181545', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3d307e-52ed-4a35-8b8b-646d64546d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d3d307e-52ed-4a35-8b8b-646d64546d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546c3fe6-27a5-4040-b892-c59aad98aefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:32 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Volume 403e7739-c2d1-42db-8c03-22e304181545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-403e7739-c2d1-42db-8c03-22e304181545', 'volume_size': 1} Jun 25 17:13:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:13:42 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=37,cinder:UPDATE=42,cinder:INSERT=7,cinder:DELETE=2 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:13:42 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:INSERT=12,cinder:SELECT=29,cinder:UPDATE=37,cinder:DELETE=3 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:13:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f5e3bf43-f8b5-4d7e-88fe-3dae17dfd80d tempest-VolumesActionsTest-781711219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.226s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:13:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f5e3bf43-f8b5-4d7e-88fe-3dae17dfd80d tempest-VolumesActionsTest-781711219 None] Uploaded volume to glance image-id: bf35dbe4-1a85-412c-b398-d0561d4b628c. {{(pid=93869) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 25 17:13:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.012s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:13:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1567338023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df114ee-7cc5-419e-828c-4fa54ea83320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4ec6661500494484f79981dd315db1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:13:19Z,use_quota=True,user_id='2ab20ada88654388a4944dea9b1ecef1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:13:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Creating volume 7df114ee-7cc5-419e-828c-4fa54ea83320 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:13:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:13:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:13:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:13:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:13:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:13:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:13:43 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:13:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7df114ee-7cc5-419e-828c-4fa54ea83320 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:43 devstack sudo[104572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7df114ee-7cc5-419e-828c-4fa54ea83320 1073741824 Jun 25 17:13:43 devstack sudo[104572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:43 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-f5e3bf43-f8b5-4d7e-88fe-3dae17dfd80d tempest-VolumesActionsTest-781711219 None] Copy volume to image completed successfully. Jun 25 17:13:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:13:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:13:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:13:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:13:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:13:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:13:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:44 devstack sudo[104572]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7df114ee-7cc5-419e-828c-4fa54ea83320 1073741824" returned: 0 in 0.971s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:44 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:13:44 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7df114ee-7cc5-419e-828c-4fa54ea83320 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:44 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7df114ee-7cc5-419e-828c-4fa54ea83320 Jun 25 17:13:44 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:45 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7df114ee-7cc5-419e-828c-4fa54ea83320" returned: 0 in 0.747s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.062s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-237363364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05a6d8c-37c0-47bd-af05-77c4eca51289,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d585cad7822243cb886f7bc409499374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:13:27Z,use_quota=True,user_id='22ee1304dd364228aa79289dbb34f4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Creating volume a05a6d8c-37c0-47bd-af05-77c4eca51289 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:13:45 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a05a6d8c-37c0-47bd-af05-77c4eca51289 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:45 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.917s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:13:45 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a05a6d8c-37c0-47bd-af05-77c4eca51289 1073741824 Jun 25 17:13:45 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dbc7a15-5d62-4c7c-9399-bd5ff86033ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7df114ee-7cc5-419e-828c-4fa54ea83320', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9df6ab-e21b-4f47-990b-0f6a677418c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 28 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:13:45 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Volume volume-7df114ee-7cc5-419e-828c-4fa54ea83320 (7df114ee-7cc5-419e-828c-4fa54ea83320): created successfully Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9df6ab-e21b-4f47-990b-0f6a677418c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Flow 'volume_create_manager' (047fe167-5695-4b9d-befc-4c3d43b89db3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:13:45 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-4edc3902-957c-4c83-8edb-b59fc875f4cb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Created volume successfully. Jun 25 17:13:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:13:46 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a05a6d8c-37c0-47bd-af05-77c4eca51289 1073741824" returned: 0 in 1.014s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a05a6d8c-37c0-47bd-af05-77c4eca51289 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:46 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a05a6d8c-37c0-47bd-af05-77c4eca51289 Jun 25 17:13:46 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:46 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a05a6d8c-37c0-47bd-af05-77c4eca51289" returned: 0 in 0.799s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:13:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:13:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.301s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:13:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:13:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-723928264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403e7739-c2d1-42db-8c03-22e304181545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30834beaa9dc4100813bdc384829d424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:13:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:13:32Z,use_quota=True,user_id='2b54b4203ea74049a8049300458a3d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:13:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Creating volume 403e7739-c2d1-42db-8c03-22e304181545 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:13:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:13:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:13:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:13:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:13:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:13:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:13:46 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:13:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-403e7739-c2d1-42db-8c03-22e304181545 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93db891-a18a-4ebe-b9ef-68047008d96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a05a6d8c-37c0-47bd-af05-77c4eca51289', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c3f5b8-8172-4ab3-a821-de00fb8543cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:47 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-403e7739-c2d1-42db-8c03-22e304181545 1073741824 Jun 25 17:13:47 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:47 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Volume volume-a05a6d8c-37c0-47bd-af05-77c4eca51289 (a05a6d8c-37c0-47bd-af05-77c4eca51289): created successfully Jun 25 17:13:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c3f5b8-8172-4ab3-a821-de00fb8543cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Flow 'volume_create_manager' (7e6ff0e2-f885-4e52-bf45-c0e329479e93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:13:47 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-41e2b9fb-af2c-4c88-ae4a-9019e21f288e tempest-VolumesTestJSON-1778589856 None] Created volume successfully. Jun 25 17:13:48 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-403e7739-c2d1-42db-8c03-22e304181545 1073741824" returned: 0 in 1.183s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-403e7739-c2d1-42db-8c03-22e304181545 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:48 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-403e7739-c2d1-42db-8c03-22e304181545 Jun 25 17:13:48 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:48 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:13:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Flow 'volume_create_manager' (3f151c9c-46cb-4442-9c2e-f7cdfce2fb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:13:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3d8145-a647-4a25-96f4-94b37099f8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3d8145-a647-4a25-96f4-94b37099f8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-480973473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=058ce001-1f12-406a-b96c-3f8f3d1cadbf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d585cad7822243cb886f7bc409499374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:13:49Z,use_quota=True,user_id='22ee1304dd364228aa79289dbb34f4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00560054-e30c-4d88-a2d0-af5953aa8d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00560054-e30c-4d88-a2d0-af5953aa8d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ac837f-9701-41d1-aa22-f276fa3d0c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76ac837f-9701-41d1-aa22-f276fa3d0c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '058ce001-1f12-406a-b96c-3f8f3d1cadbf', 'volume_name': 'volume-058ce001-1f12-406a-b96c-3f8f3d1cadbf', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c60c5b-079e-4b19-b80f-ae9279b97daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c60c5b-079e-4b19-b80f-ae9279b97daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (166feed4-6b87-4ef1-874b-7e3a68f99637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:48 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Volume 058ce001-1f12-406a-b96c-3f8f3d1cadbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-058ce001-1f12-406a-b96c-3f8f3d1cadbf', 'volume_size': 1} Jun 25 17:13:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:13:48 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-403e7739-c2d1-42db-8c03-22e304181545" returned: 0 in 0.738s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] <== create_volume: return (1991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:13:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:13:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.366s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:13:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546c3fe6-27a5-4040-b892-c59aad98aefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-403e7739-c2d1-42db-8c03-22e304181545', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75ee3da-1678-464e-b906-0b1e4b244762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:49 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[56429aa5-ca40-4716-b276-be75f3de7050]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:13:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:49 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Volume volume-403e7739-c2d1-42db-8c03-22e304181545 (403e7739-c2d1-42db-8c03-22e304181545): created successfully Jun 25 17:13:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75ee3da-1678-464e-b906-0b1e4b244762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Flow 'volume_create_manager' (d89385e4-9a90-4d6a-b6fd-843110a1189c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:13:49 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-8f94cd37-db2f-4196-85bc-dbaf070b0d47 tempest-VolumesListAdminTestJSON-1693521582 None] Created volume successfully. Jun 25 17:13:49 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 Jun 25 17:13:49 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-adae5944-ceaf-4a48-9de1-9e1ddcc867e3 req-abbabb2f-6cf1-4823-bc88-0c6d45d98852 tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:13:49 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56" returned: 0 in 0.922s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:49 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[545eee3a-8715-433c-b20d-cab84c730eed]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:13:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:50 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 Jun 25 17:13:50 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:50 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:13:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Flow 'volume_create_manager' (baa8b886-c463-4d8d-96b8-4cef8ae55020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:13:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78864d33-5cfd-4276-bb96-bd938a6a43d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78864d33-5cfd-4276-bb96-bd938a6a43d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2037256953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82cedc7c-7e12-461b-aacc-827f9dde67b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30834beaa9dc4100813bdc384829d424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:13:50Z,use_quota=True,user_id='2b54b4203ea74049a8049300458a3d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631929f2-c02e-46fa-8974-579eb7e1b627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631929f2-c02e-46fa-8974-579eb7e1b627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d66f88-9174-47a4-a916-3f4a10777854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d66f88-9174-47a4-a916-3f4a10777854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82cedc7c-7e12-461b-aacc-827f9dde67b2', 'volume_name': 'volume-82cedc7c-7e12-461b-aacc-827f9dde67b2', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b4e29c-1a34-48ab-a66c-859d7eaef862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07b4e29c-1a34-48ab-a66c-859d7eaef862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:13:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb52af3-11e8-4a86-8206-b8e7aaca9063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:13:50 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Volume 82cedc7c-7e12-461b-aacc-827f9dde67b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82cedc7c-7e12-461b-aacc-827f9dde67b2', 'volume_size': 1} Jun 25 17:13:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:13:51 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56" returned: 0 in 1.101s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 /opt/stack/data/cinder/conversion/5a3270c4-d236-49d1-8685-b54046aacd56.temp_image.616545a4-7ed3-4c23-95a8-6afd909ed657c4wzfu2y.img {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:51 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 /opt/stack/data/cinder/conversion/5a3270c4-d236-49d1-8685-b54046aacd56.temp_image.616545a4-7ed3-4c23-95a8-6afd909ed657c4wzfu2y.img Jun 25 17:13:51 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:56 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 /opt/stack/data/cinder/conversion/5a3270c4-d236-49d1-8685-b54046aacd56.temp_image.616545a4-7ed3-4c23-95a8-6afd909ed657c4wzfu2y.img" returned: 0 in 5.059s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:56 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[03180ad5-8c7e-4c3a-ac47-90a5d183f49f]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:13:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:56 devstack sudo[104645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 Jun 25 17:13:56 devstack sudo[104645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:57 devstack sudo[104645]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56" returned: 0 in 1.110s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:57 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] Image conversion details: src /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56, size 1024.00 MB, duration 5.06 sec, destination /opt/stack/data/cinder/conversion/5a3270c4-d236-49d1-8685-b54046aacd56.temp_image.616545a4-7ed3-4c23-95a8-6afd909ed657c4wzfu2y.img {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:13:57 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] Converted 1024.00 MB image at 202.36 MB/s Jun 25 17:13:57 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] 616545a4-7ed3-4c23-95a8-6afd909ed657 was raw, converting to qcow2 {{(pid=93869) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 25 17:13:57 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0556b56-4983-4b10-afc9-17486b26e080]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:13:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5a3270c4-d236-49d1-8685-b54046aacd56.temp_image.616545a4-7ed3-4c23-95a8-6afd909ed657c4wzfu2y.img {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:57 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5a3270c4-d236-49d1-8685-b54046aacd56.temp_image.616545a4-7ed3-4c23-95a8-6afd909ed657c4wzfu2y.img Jun 25 17:13:57 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:58 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/5a3270c4-d236-49d1-8685-b54046aacd56.temp_image.616545a4-7ed3-4c23-95a8-6afd909ed657c4wzfu2y.img" returned: 0 in 0.946s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5a3270c4-d236-49d1-8685-b54046aacd56.temp_image.616545a4-7ed3-4c23-95a8-6afd909ed657c4wzfu2y.img {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:58 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5a3270c4-d236-49d1-8685-b54046aacd56.temp_image.616545a4-7ed3-4c23-95a8-6afd909ed657c4wzfu2y.img Jun 25 17:13:58 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:59 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5a3270c4-d236-49d1-8685-b54046aacd56.temp_image.616545a4-7ed3-4c23-95a8-6afd909ed657c4wzfu2y.img" returned: 1 in 0.862s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/5a3270c4-d236-49d1-8685-b54046aacd56.temp_image.616545a4-7ed3-4c23-95a8-6afd909ed657c4wzfu2y.img' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:13:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5a3270c4-d236-49d1-8685-b54046aacd56.temp_image.616545a4-7ed3-4c23-95a8-6afd909ed657c4wzfu2y.img /opt/stack/data/cinder/conversion/vol_upload__3zvg71y {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:13:59 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5a3270c4-d236-49d1-8685-b54046aacd56.temp_image.616545a4-7ed3-4c23-95a8-6afd909ed657c4wzfu2y.img /opt/stack/data/cinder/conversion/vol_upload__3zvg71y Jun 25 17:13:59 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:13:59 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Jun 25 17:13:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/5a3270c4-d236-49d1-8685-b54046aacd56.temp_image.616545a4-7ed3-4c23-95a8-6afd909ed657c4wzfu2y.img /opt/stack/data/cinder/conversion/vol_upload__3zvg71y" returned: 0 in 0.799s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:13:59 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] Image conversion details: src /opt/stack/data/cinder/conversion/5a3270c4-d236-49d1-8685-b54046aacd56.temp_image.616545a4-7ed3-4c23-95a8-6afd909ed657c4wzfu2y.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload__3zvg71y {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:13:59 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 25 17:13:59 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a814a10c-afa6-45cc-abfa-0a874efcd409]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:13:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__3zvg71y {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:00 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__3zvg71y Jun 25 17:14:00 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:00 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload__3zvg71y" returned: 0 in 0.962s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.667s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] Uploaded volume to glance image-id: 616545a4-7ed3-4c23-95a8-6afd909ed657. {{(pid=93869) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 25 17:14:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.852s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-480973473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=058ce001-1f12-406a-b96c-3f8f3d1cadbf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d585cad7822243cb886f7bc409499374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:13:49Z,use_quota=True,user_id='22ee1304dd364228aa79289dbb34f4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:14:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Creating volume 058ce001-1f12-406a-b96c-3f8f3d1cadbf {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:14:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:14:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:14:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:14:02 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:14:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-058ce001-1f12-406a-b96c-3f8f3d1cadbf 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:02 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-058ce001-1f12-406a-b96c-3f8f3d1cadbf 1073741824 Jun 25 17:14:02 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:02 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-33675997-fb68-4f60-9322-066799861009 tempest-VolumesActionsTest-781711219 None] Copy volume to image completed successfully. Jun 25 17:14:03 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-058ce001-1f12-406a-b96c-3f8f3d1cadbf 1073741824" returned: 0 in 1.114s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-058ce001-1f12-406a-b96c-3f8f3d1cadbf {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:03 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-058ce001-1f12-406a-b96c-3f8f3d1cadbf Jun 25 17:14:03 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] Acquiring lock "cinder-5a3270c4-d236-49d1-8685-b54046aacd56-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] Lock "cinder-5a3270c4-d236-49d1-8685-b54046aacd56-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] Acquiring lock "cinder-quobyte-5a3270c4-d236-49d1-8685-b54046aacd56" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] Lock "cinder-quobyte-5a3270c4-d236-49d1-8685-b54046aacd56" acquired by "delete_volume" :: waited 0.033s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:04 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9e6469-ee3c-459e-8ff1-30a5dd2ee03b]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:04 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-058ce001-1f12-406a-b96c-3f8f3d1cadbf" returned: 0 in 0.755s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:14:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-adae5944-ceaf-4a48-9de1-9e1ddcc867e3 req-abbabb2f-6cf1-4823-bc88-0c6d45d98852 tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 15.375s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (166feed4-6b87-4ef1-874b-7e3a68f99637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-058ce001-1f12-406a-b96c-3f8f3d1cadbf', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4315674e-ca74-4cec-b0ae-6c987163337e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:04 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1b84a2-8ee6-4f8f-b2ac-426a089cfa35]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-adae5944-ceaf-4a48-9de1-9e1ddcc867e3 req-abbabb2f-6cf1-4823-bc88-0c6d45d98852 tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7df114ee-7cc5-419e-828c-4fa54ea83320 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:04 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Volume volume-058ce001-1f12-406a-b96c-3f8f3d1cadbf (058ce001-1f12-406a-b96c-3f8f3d1cadbf): created successfully Jun 25 17:14:04 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 Jun 25 17:14:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4315674e-ca74-4cec-b0ae-6c987163337e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:04 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Flow 'volume_create_manager' (3f151c9c-46cb-4442-9c2e-f7cdfce2fb37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:14:04 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-531565e4-c744-431b-9680-f4e45058b4d4 tempest-VolumesTestJSON-1778589856 None] Created volume successfully. Jun 25 17:14:04 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7df114ee-7cc5-419e-828c-4fa54ea83320 Jun 25 17:14:04 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:05 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56" returned: 0 in 1.059s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:05 devstack sudo[104697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56 Jun 25 17:14:05 devstack sudo[104697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:05 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-adae5944-ceaf-4a48-9de1-9e1ddcc867e3 req-abbabb2f-6cf1-4823-bc88-0c6d45d98852 tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7df114ee-7cc5-419e-828c-4fa54ea83320" returned: 0 in 1.147s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-adae5944-ceaf-4a48-9de1-9e1ddcc867e3 req-abbabb2f-6cf1-4823-bc88-0c6d45d98852 tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.188s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.221s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2037256953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82cedc7c-7e12-461b-aacc-827f9dde67b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30834beaa9dc4100813bdc384829d424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:13:50Z,use_quota=True,user_id='2b54b4203ea74049a8049300458a3d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:14:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Creating volume 82cedc7c-7e12-461b-aacc-827f9dde67b2 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:14:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:14:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:14:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:14:05 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:14:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-82cedc7c-7e12-461b-aacc-827f9dde67b2 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:05 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-82cedc7c-7e12-461b-aacc-827f9dde67b2 1073741824 Jun 25 17:14:05 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-adae5944-ceaf-4a48-9de1-9e1ddcc867e3 req-abbabb2f-6cf1-4823-bc88-0c6d45d98852 tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-7df114ee-7cc5-419e-828c-4fa54ea83320', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a279d73-9200-49b8-a1ae-05f1446fbea6', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:14:05 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Flow 'volume_create_manager' (3287087c-f0d6-48a9-a1a8-b2012623cee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a44e126-7bbc-4db3-9cee-f0b558928353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:06 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-adae5944-ceaf-4a48-9de1-9e1ddcc867e3 req-abbabb2f-6cf1-4823-bc88-0c6d45d98852 tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] attachment_update completed successfully. Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a44e126-7bbc-4db3-9cee-f0b558928353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-747944330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c848fa9-c327-4445-b3a1-f4c3916f30a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d585cad7822243cb886f7bc409499374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:14:06Z,use_quota=True,user_id='22ee1304dd364228aa79289dbb34f4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d36e29-3fdb-49b2-9d64-eedfb8c936a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03d36e29-3fdb-49b2-9d64-eedfb8c936a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8ac3d8-2d21-44f9-89e0-10c7c489850b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8ac3d8-2d21-44f9-89e0-10c7c489850b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c848fa9-c327-4445-b3a1-f4c3916f30a2', 'volume_name': 'volume-4c848fa9-c327-4445-b3a1-f4c3916f30a2', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd69344-c011-47ba-ad15-f48361d6ce32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cd69344-c011-47ba-ad15-f48361d6ce32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7541db76-54a3-457b-84b2-0290b588ec16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:06 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Volume 4c848fa9-c327-4445-b3a1-f4c3916f30a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c848fa9-c327-4445-b3a1-f4c3916f30a2', 'volume_size': 1} Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:06 devstack sudo[104697]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5a3270c4-d236-49d1-8685-b54046aacd56" returned: 0 in 0.966s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] Lock "cinder-quobyte-5a3270c4-d236-49d1-8685-b54046aacd56" released by "delete_volume" :: held 2.092s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] Created reservations ['8352a9fc-53ad-4e01-a57d-97306d1fa21e', '47de9aaa-317d-4cc6-8819-7bc627f98d40', '01c712c3-6dfb-4171-adf6-aef627102129', '1e710753-566f-4fe1-867b-4267dd7128d3'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:06 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:14:06 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:06 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-82cedc7c-7e12-461b-aacc-827f9dde67b2 1073741824" returned: 0 in 1.147s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-82cedc7c-7e12-461b-aacc-827f9dde67b2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:07 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-82cedc7c-7e12-461b-aacc-827f9dde67b2 Jun 25 17:14:07 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:07 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.897s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:07 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:14:07 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] Deleted volume successfully. Jun 25 17:14:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-40f5cb37-4868-4820-9361-c27a546f4b2c tempest-VolumesActionsTest-781711219 None] Lock "cinder-5a3270c4-d236-49d1-8685-b54046aacd56-delete_volume" released by "delete_volume" :: held 3.284s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:07 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-82cedc7c-7e12-461b-aacc-827f9dde67b2" returned: 0 in 0.930s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] <== create_volume: return (2147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:14:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.153s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.848s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-747944330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c848fa9-c327-4445-b3a1-f4c3916f30a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d585cad7822243cb886f7bc409499374',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:14:06Z,use_quota=True,user_id='22ee1304dd364228aa79289dbb34f4a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:14:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Creating volume 4c848fa9-c327-4445-b3a1-f4c3916f30a2 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:14:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:14:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:14:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:14:07 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:14:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4c848fa9-c327-4445-b3a1-f4c3916f30a2 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb52af3-11e8-4a86-8206-b8e7aaca9063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82cedc7c-7e12-461b-aacc-827f9dde67b2', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:07 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4c848fa9-c327-4445-b3a1-f4c3916f30a2 1073741824 Jun 25 17:14:07 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:08 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c9c347-230d-4843-a448-d86e1c605753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:08 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Volume volume-82cedc7c-7e12-461b-aacc-827f9dde67b2 (82cedc7c-7e12-461b-aacc-827f9dde67b2): created successfully Jun 25 17:14:08 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14c9c347-230d-4843-a448-d86e1c605753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:08 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Flow 'volume_create_manager' (baa8b886-c463-4d8d-96b8-4cef8ae55020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:14:08 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-34ec7fa8-151e-4c51-9ed0-a2e5b02ffab3 tempest-VolumesListAdminTestJSON-1693521582 None] Created volume successfully. Jun 25 17:14:09 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:14:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Flow 'volume_create_manager' (4700f874-4b82-48ab-a48d-0d53fc03f1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:14:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222be2aa-b505-4eb7-bd7c-c77aa09f1671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (222be2aa-b505-4eb7-bd7c-c77aa09f1671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-892090304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db87f516-926b-4890-a3f3-6b94d0f164f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30834beaa9dc4100813bdc384829d424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:14:09Z,use_quota=True,user_id='2b54b4203ea74049a8049300458a3d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97725fa1-d634-41e8-8b25-1d2932cdbeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97725fa1-d634-41e8-8b25-1d2932cdbeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ec8b3c-5761-4116-88e7-0d15b55ea932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71ec8b3c-5761-4116-88e7-0d15b55ea932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db87f516-926b-4890-a3f3-6b94d0f164f1', 'volume_name': 'volume-db87f516-926b-4890-a3f3-6b94d0f164f1', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:09 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a80dca8a-5d96-4ccf-9a92-cb1fd1a34307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a80dca8a-5d96-4ccf-9a92-cb1fd1a34307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a87b0a-3ba9-41d2-8f74-3b6caab5bc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:09 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Volume db87f516-926b-4890-a3f3-6b94d0f164f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db87f516-926b-4890-a3f3-6b94d0f164f1', 'volume_size': 1} Jun 25 17:14:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4c848fa9-c327-4445-b3a1-f4c3916f30a2 1073741824" returned: 0 in 1.374s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4c848fa9-c327-4445-b3a1-f4c3916f30a2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:09 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4c848fa9-c327-4445-b3a1-f4c3916f30a2 Jun 25 17:14:09 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:10 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4c848fa9-c327-4445-b3a1-f4c3916f30a2" returned: 0 in 0.839s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] <== create_volume: return (2274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:14:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.278s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.898s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-892090304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db87f516-926b-4890-a3f3-6b94d0f164f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30834beaa9dc4100813bdc384829d424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:14:09Z,use_quota=True,user_id='2b54b4203ea74049a8049300458a3d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:14:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Creating volume db87f516-926b-4890-a3f3-6b94d0f164f1 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:14:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:14:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:14:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:14:10 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:14:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-db87f516-926b-4890-a3f3-6b94d0f164f1 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:10 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-db87f516-926b-4890-a3f3-6b94d0f164f1 1073741824 Jun 25 17:14:10 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7541db76-54a3-457b-84b2-0290b588ec16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c848fa9-c327-4445-b3a1-f4c3916f30a2', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78db966-07d5-42cd-8793-cf527221b976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:10 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Volume volume-4c848fa9-c327-4445-b3a1-f4c3916f30a2 (4c848fa9-c327-4445-b3a1-f4c3916f30a2): created successfully Jun 25 17:14:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78db966-07d5-42cd-8793-cf527221b976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Flow 'volume_create_manager' (3287087c-f0d6-48a9-a1a8-b2012623cee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:14:10 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-4b96c0cf-31ca-4f8f-a0ce-56c41f7cfc7d tempest-VolumesTestJSON-1778589856 None] Created volume successfully. Jun 25 17:14:11 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-db87f516-926b-4890-a3f3-6b94d0f164f1 1073741824" returned: 0 in 1.522s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-db87f516-926b-4890-a3f3-6b94d0f164f1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:11 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-db87f516-926b-4890-a3f3-6b94d0f164f1 Jun 25 17:14:11 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:12 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-db87f516-926b-4890-a3f3-6b94d0f164f1" returned: 0 in 1.107s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] <== create_volume: return (2715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:14:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.720s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a87b0a-3ba9-41d2-8f74-3b6caab5bc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db87f516-926b-4890-a3f3-6b94d0f164f1', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a43ee63-fd74-476a-a249-9e2ed19c0f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:13 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Volume volume-db87f516-926b-4890-a3f3-6b94d0f164f1 (db87f516-926b-4890-a3f3-6b94d0f164f1): created successfully Jun 25 17:14:13 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a43ee63-fd74-476a-a249-9e2ed19c0f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:13 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Flow 'volume_create_manager' (4700f874-4b82-48ab-a48d-0d53fc03f1b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:14:13 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-47588f46-cf29-4b5b-b603-6469dde950fd tempest-VolumesListAdminTestJSON-1693521582 None] Created volume successfully. Jun 25 17:14:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] Acquiring lock "cinder-4c848fa9-c327-4445-b3a1-f4c3916f30a2-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] Lock "cinder-4c848fa9-c327-4445-b3a1-f4c3916f30a2-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] Acquiring lock "cinder-quobyte-4c848fa9-c327-4445-b3a1-f4c3916f30a2" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] Lock "cinder-quobyte-4c848fa9-c327-4445-b3a1-f4c3916f30a2" acquired by "delete_volume" :: waited 0.028s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:13 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d9880d-9658-4297-a21a-9c642c3fb688]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4c848fa9-c327-4445-b3a1-f4c3916f30a2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:13 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4c848fa9-c327-4445-b3a1-f4c3916f30a2 Jun 25 17:14:13 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Flow 'volume_create_manager' (0dcd3b99-4b49-4e3f-b318-42ffa608ff7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d404f9-db04-43d5-ac3a-10bed795a5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d404f9-db04-43d5-ac3a-10bed795a5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496bf7c1-15ff-4eaa-a352-cad6636f27e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3686fd0b4c4836b660b85de6d54ebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:14:14Z,use_quota=True,user_id='a815a5b4d85441cca7b71075b829ac34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee5aace-0361-4a07-8e6f-60d99f881544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee5aace-0361-4a07-8e6f-60d99f881544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93199ad-e56f-4769-aadf-08f08ea43482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93199ad-e56f-4769-aadf-08f08ea43482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '496bf7c1-15ff-4eaa-a352-cad6636f27e8', 'volume_name': 'volume-496bf7c1-15ff-4eaa-a352-cad6636f27e8', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4762676e-5695-45e0-ae00-3e7ca8c9e950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4762676e-5695-45e0-ae00-3e7ca8c9e950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09bb2f2d-4387-42fd-bdad-54766b19c10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:14 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Volume 496bf7c1-15ff-4eaa-a352-cad6636f27e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-496bf7c1-15ff-4eaa-a352-cad6636f27e8', 'volume_size': 1} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=496bf7c1-15ff-4eaa-a352-cad6636f27e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b3686fd0b4c4836b660b85de6d54ebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:14:14Z,use_quota=True,user_id='a815a5b4d85441cca7b71075b829ac34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Creating volume 496bf7c1-15ff-4eaa-a352-cad6636f27e8 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:14:14 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:14:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-496bf7c1-15ff-4eaa-a352-cad6636f27e8 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:14 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-496bf7c1-15ff-4eaa-a352-cad6636f27e8 1073741824 Jun 25 17:14:14 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:15 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-d8e791dd-caa9-443d-a7f4-acacfcfd1060 req-f508ef12-aed0-482a-81bd-879acc03c631 tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Terminate volume connection completed successfully. Jun 25 17:14:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-d8e791dd-caa9-443d-a7f4-acacfcfd1060 req-f508ef12-aed0-482a-81bd-879acc03c631 tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Deleting attachment 7a279d73-9200-49b8-a1ae-05f1446fbea6. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:14:15 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4c848fa9-c327-4445-b3a1-f4c3916f30a2" returned: 0 in 1.373s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4c848fa9-c327-4445-b3a1-f4c3916f30a2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:15 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4c848fa9-c327-4445-b3a1-f4c3916f30a2 Jun 25 17:14:15 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:15 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-496bf7c1-15ff-4eaa-a352-cad6636f27e8 1073741824" returned: 0 in 1.250s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-496bf7c1-15ff-4eaa-a352-cad6636f27e8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:16 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-496bf7c1-15ff-4eaa-a352-cad6636f27e8 Jun 25 17:14:16 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:16 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4c848fa9-c327-4445-b3a1-f4c3916f30a2" returned: 0 in 0.960s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:16 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] Lock "cinder-quobyte-4c848fa9-c327-4445-b3a1-f4c3916f30a2" released by "delete_volume" :: held 2.392s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:16 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] Created reservations ['ac572688-7f20-4b65-9faa-fd9831c41b9b', '620635ab-675e-4c3d-9977-8c86eefc22f3', '401d20c8-7aef-42fc-bf59-37c2377758c6', '0ff9212f-e3bd-4b73-8919-0ced0a564bcf'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:14:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:14:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:14:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:16 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:14:16 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Flow 'volume_create_manager' (7792ffbb-5f8f-44cc-895c-f9195b8e117c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b394092-b747-4a61-89b5-32fe499a1b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:17 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-496bf7c1-15ff-4eaa-a352-cad6636f27e8" returned: 0 in 1.110s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] <== create_volume: return (2452ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.457s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b394092-b747-4a61-89b5-32fe499a1b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1891420095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89de173-09f2-4b4a-a5de-d9f3059d04d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a97ff00ebbd4dca98af273ed7a26973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:14:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:14:17Z,use_quota=True,user_id='2f553c6c9a0841dbb292f50420e52689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8162de65-dabc-434d-97db-f8fb34e2558b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8162de65-dabc-434d-97db-f8fb34e2558b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6975cefe-4e82-455e-8125-676ab1aea2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6975cefe-4e82-455e-8125-676ab1aea2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a89de173-09f2-4b4a-a5de-d9f3059d04d0', 'volume_name': 'volume-a89de173-09f2-4b4a-a5de-d9f3059d04d0', 'volume_size': 2}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ae3127-14d0-4b32-837f-81dc2326b925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ae3127-14d0-4b32-837f-81dc2326b925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5f3631-2882-4caa-a04c-5a03fb0f7ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:17 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Volume a89de173-09f2-4b4a-a5de-d9f3059d04d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a89de173-09f2-4b4a-a5de-d9f3059d04d0', 'volume_size': 2} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1891420095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a89de173-09f2-4b4a-a5de-d9f3059d04d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a97ff00ebbd4dca98af273ed7a26973',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:14:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:14:17Z,use_quota=True,user_id='2f553c6c9a0841dbb292f50420e52689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Creating volume a89de173-09f2-4b4a-a5de-d9f3059d04d0 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:14:17 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a89de173-09f2-4b4a-a5de-d9f3059d04d0 2147483648 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] Acquiring lock "cinder-058ce001-1f12-406a-b96c-3f8f3d1cadbf-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Acquiring lock "cinder-7df114ee-7cc5-419e-828c-4fa54ea83320-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:17 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a89de173-09f2-4b4a-a5de-d9f3059d04d0 2147483648 Jun 25 17:14:17 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09bb2f2d-4387-42fd-bdad-54766b19c10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-496bf7c1-15ff-4eaa-a352-cad6636f27e8', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b33bf2-6156-40b3-8142-c9c175db7424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] Lock "cinder-058ce001-1f12-406a-b96c-3f8f3d1cadbf-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Lock "cinder-7df114ee-7cc5-419e-828c-4fa54ea83320-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:17 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:17 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Volume volume-496bf7c1-15ff-4eaa-a352-cad6636f27e8 (496bf7c1-15ff-4eaa-a352-cad6636f27e8): created successfully Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5b33bf2-6156-40b3-8142-c9c175db7424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Flow 'volume_create_manager' (0dcd3b99-4b49-4e3f-b318-42ffa608ff7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.101s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:14:17 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-fb290945-d2cf-4576-8a67-87dcbd81e7a2 tempest-VolumesListAdminTestJSON-1479192311 None] Created volume successfully. Jun 25 17:14:17 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] Deleted volume successfully. Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] Acquiring lock "cinder-quobyte-058ce001-1f12-406a-b96c-3f8f3d1cadbf" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Acquiring lock "cinder-quobyte-7df114ee-7cc5-419e-828c-4fa54ea83320" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5b8cd3ea-8a25-4b48-a8e0-a727813ba75d tempest-VolumesTestJSON-1778589856 None] Lock "cinder-4c848fa9-c327-4445-b3a1-f4c3916f30a2-delete_volume" released by "delete_volume" :: held 3.990s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] Lock "cinder-quobyte-058ce001-1f12-406a-b96c-3f8f3d1cadbf" acquired by "delete_volume" :: waited 0.073s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1ff16d-39e4-448c-9c8a-08bc7d95a2f9]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-058ce001-1f12-406a-b96c-3f8f3d1cadbf {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Lock "cinder-quobyte-7df114ee-7cc5-419e-828c-4fa54ea83320" acquired by "delete_volume" :: waited 0.060s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1de1902-a0e9-4c0e-be55-310cc929f7dd]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7df114ee-7cc5-419e-828c-4fa54ea83320 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:17 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-058ce001-1f12-406a-b96c-3f8f3d1cadbf Jun 25 17:14:17 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] Acquiring lock "cinder-496bf7c1-15ff-4eaa-a352-cad6636f27e8-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] Lock "cinder-496bf7c1-15ff-4eaa-a352-cad6636f27e8-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:17 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7df114ee-7cc5-419e-828c-4fa54ea83320 Jun 25 17:14:17 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:18 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] Acquiring lock "cinder-quobyte-496bf7c1-15ff-4eaa-a352-cad6636f27e8" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:18 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] Lock "cinder-quobyte-496bf7c1-15ff-4eaa-a352-cad6636f27e8" acquired by "delete_volume" :: waited 0.050s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:18 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b8ec2d-72ea-4860-bb1e-52597063e5e7]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-496bf7c1-15ff-4eaa-a352-cad6636f27e8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:18 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] Acquiring lock "cinder-db87f516-926b-4890-a3f3-6b94d0f164f1-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:18 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] Lock "cinder-db87f516-926b-4890-a3f3-6b94d0f164f1-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:18 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] Acquiring lock "cinder-quobyte-db87f516-926b-4890-a3f3-6b94d0f164f1" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:18 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] Lock "cinder-quobyte-db87f516-926b-4890-a3f3-6b94d0f164f1" acquired by "delete_volume" :: waited 0.063s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:18 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-496bf7c1-15ff-4eaa-a352-cad6636f27e8 Jun 25 17:14:18 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:18 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9d8903-652f-461e-b266-2efb79b2a285]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-db87f516-926b-4890-a3f3-6b94d0f164f1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:18 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-db87f516-926b-4890-a3f3-6b94d0f164f1 Jun 25 17:14:18 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:18 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a89de173-09f2-4b4a-a5de-d9f3059d04d0 2147483648" returned: 0 in 1.669s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a89de173-09f2-4b4a-a5de-d9f3059d04d0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:18 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a89de173-09f2-4b4a-a5de-d9f3059d04d0 Jun 25 17:14:18 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:19 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-058ce001-1f12-406a-b96c-3f8f3d1cadbf" returned: 0 in 1.422s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-058ce001-1f12-406a-b96c-3f8f3d1cadbf {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:19 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-058ce001-1f12-406a-b96c-3f8f3d1cadbf Jun 25 17:14:19 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:19 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7df114ee-7cc5-419e-828c-4fa54ea83320" returned: 0 in 1.489s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7df114ee-7cc5-419e-828c-4fa54ea83320 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:19 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7df114ee-7cc5-419e-828c-4fa54ea83320 Jun 25 17:14:19 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:19 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-496bf7c1-15ff-4eaa-a352-cad6636f27e8" returned: 0 in 1.409s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-496bf7c1-15ff-4eaa-a352-cad6636f27e8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:19 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-496bf7c1-15ff-4eaa-a352-cad6636f27e8 Jun 25 17:14:19 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:19 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-db87f516-926b-4890-a3f3-6b94d0f164f1" returned: 0 in 1.354s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-db87f516-926b-4890-a3f3-6b94d0f164f1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:19 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-db87f516-926b-4890-a3f3-6b94d0f164f1 Jun 25 17:14:19 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:19 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a89de173-09f2-4b4a-a5de-d9f3059d04d0" returned: 0 in 1.023s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:19 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] <== create_volume: return (2782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:14:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.787s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:19 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc5f3631-2882-4caa-a04c-5a03fb0f7ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a89de173-09f2-4b4a-a5de-d9f3059d04d0', 'volume_size': 2}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20ce517-bd5f-4aaf-86b2-4495ecc82220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:20 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Volume volume-a89de173-09f2-4b4a-a5de-d9f3059d04d0 (a89de173-09f2-4b4a-a5de-d9f3059d04d0): created successfully Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20ce517-bd5f-4aaf-86b2-4495ecc82220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Flow 'volume_create_manager' (7792ffbb-5f8f-44cc-895c-f9195b8e117c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:14:20 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-a32900b4-250b-4ebc-a5da-90d32a72aa4b tempest-VolumesCloneNegativeTest-267501402 None] Created volume successfully. Jun 25 17:14:20 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-058ce001-1f12-406a-b96c-3f8f3d1cadbf" returned: 0 in 1.068s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] Lock "cinder-quobyte-058ce001-1f12-406a-b96c-3f8f3d1cadbf" released by "delete_volume" :: held 2.550s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] Created reservations ['83701394-5af9-419c-8001-7d14f87c5316', 'af345351-6f39-4e91-b322-511d0c899fb8', '440e1ad8-50b4-486f-ab8e-a3d175295ede', '06d1879e-d97d-4038-bd4c-c80edc30e67b'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:20 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7df114ee-7cc5-419e-828c-4fa54ea83320" returned: 0 in 1.310s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:20 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:14:20 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Lock "cinder-quobyte-7df114ee-7cc5-419e-828c-4fa54ea83320" released by "delete_volume" :: held 2.900s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Created reservations ['60017132-6b9e-4f1e-b06d-d1d9fc885182', '2b24b7b8-256d-4377-89a3-5333050d9fff', '99d65fd2-4b92-472a-a79d-f956610db6a0', '3505a411-c4f3-4e77-803a-62d9749273b4'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:14:20 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-496bf7c1-15ff-4eaa-a352-cad6636f27e8" returned: 0 in 1.223s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] Lock "cinder-quobyte-496bf7c1-15ff-4eaa-a352-cad6636f27e8" released by "delete_volume" :: held 2.721s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:20 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] Acquiring lock "cinder-a89de173-09f2-4b4a-a5de-d9f3059d04d0-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-db87f516-926b-4890-a3f3-6b94d0f164f1" returned: 0 in 1.039s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] Lock "cinder-quobyte-db87f516-926b-4890-a3f3-6b94d0f164f1" released by "delete_volume" :: held 2.502s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] Lock "cinder-a89de173-09f2-4b4a-a5de-d9f3059d04d0-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] Acquiring lock "cinder-a05a6d8c-37c0-47bd-af05-77c4eca51289-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:21 devstack sudo[105220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:14:21 devstack sudo[105220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] Lock "cinder-a05a6d8c-37c0-47bd-af05-77c4eca51289-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] Acquiring lock "cinder-quobyte-a89de173-09f2-4b4a-a5de-d9f3059d04d0" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] Created reservations ['519a8523-31a3-4aa8-bbbc-54af21371d12', 'b4ada9c4-3afc-421b-a0b0-ffaf23aae5f5', 'f39f2b3c-af11-46a9-99fc-c7678b18d658', 'e2285d9a-6d77-47b8-ad3c-9ca32d472fe0'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] Lock "cinder-quobyte-a89de173-09f2-4b4a-a5de-d9f3059d04d0" acquired by "delete_volume" :: waited 0.058s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7284f5bf-9124-460f-a1a1-a632bb4f3ec7]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a89de173-09f2-4b4a-a5de-d9f3059d04d0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] Created reservations ['0af24013-75d4-4c37-9ec7-21bf2aa46b43', '1e9a212f-52c9-4311-be7a-36522ca8976b', '1c4257c0-b6a5-4843-bf30-5817d7091f4f', '46e133e1-bae0-4ce0-bf32-c567d29327db'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] Acquiring lock "cinder-quobyte-a05a6d8c-37c0-47bd-af05-77c4eca51289" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] Lock "cinder-quobyte-a05a6d8c-37c0-47bd-af05-77c4eca51289" acquired by "delete_volume" :: waited 0.050s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[226b006c-f1f1-42c9-8d73-6732d322911a]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a05a6d8c-37c0-47bd-af05-77c4eca51289 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:21 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a89de173-09f2-4b4a-a5de-d9f3059d04d0 Jun 25 17:14:21 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:21 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a05a6d8c-37c0-47bd-af05-77c4eca51289 Jun 25 17:14:21 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:21 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:14:21 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:21 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:14:21 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:21 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.303s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:14:21 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] Deleted volume successfully. Jun 25 17:14:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3e96f0dc-49af-4c71-ba46-bc4d14b5fe18 tempest-VolumesTestJSON-1778589856 None] Lock "cinder-058ce001-1f12-406a-b96c-3f8f3d1cadbf-delete_volume" released by "delete_volume" :: held 4.603s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:22 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] Acquiring lock "cinder-82cedc7c-7e12-461b-aacc-827f9dde67b2-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:22 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] Lock "cinder-82cedc7c-7e12-461b-aacc-827f9dde67b2-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:22 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] Acquiring lock "cinder-quobyte-82cedc7c-7e12-461b-aacc-827f9dde67b2" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:22 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] Lock "cinder-quobyte-82cedc7c-7e12-461b-aacc-827f9dde67b2" acquired by "delete_volume" :: waited 0.058s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:22 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e7b819-a662-453c-9561-37ab216dfed9]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-82cedc7c-7e12-461b-aacc-827f9dde67b2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:22 devstack sudo[105220]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.424s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:22 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:14:22 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Deleted volume successfully. Jun 25 17:14:22 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f199535b-a1ea-43a4-9c31-aae1e2406adb tempest-TestServerVolumeAttachScenarioOldVersion-1519551082 None] Lock "cinder-7df114ee-7cc5-419e-828c-4fa54ea83320-delete_volume" released by "delete_volume" :: held 5.180s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:22 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-82cedc7c-7e12-461b-aacc-827f9dde67b2 Jun 25 17:14:22 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:22 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.302s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:22 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:14:22 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] Deleted volume successfully. Jun 25 17:14:22 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-2ffa8ffb-bbe7-47c5-9717-42ea5847a456 tempest-VolumesListAdminTestJSON-1479192311 None] Lock "cinder-496bf7c1-15ff-4eaa-a352-cad6636f27e8-delete_volume" released by "delete_volume" :: held 4.837s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:23 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:23 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.490s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:23 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:14:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a89de173-09f2-4b4a-a5de-d9f3059d04d0" returned: 0 in 1.842s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:23 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] Deleted volume successfully. Jun 25 17:14:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a89de173-09f2-4b4a-a5de-d9f3059d04d0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:23 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a05a6d8c-37c0-47bd-af05-77c4eca51289" returned: 0 in 1.738s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a05a6d8c-37c0-47bd-af05-77c4eca51289 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:23 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a89de173-09f2-4b4a-a5de-d9f3059d04d0 Jun 25 17:14:23 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:23 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a05a6d8c-37c0-47bd-af05-77c4eca51289 Jun 25 17:14:23 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b7a3a400-b124-4d7a-a03e-48d53be22806 tempest-VolumesListAdminTestJSON-1693521582 None] Lock "cinder-db87f516-926b-4890-a3f3-6b94d0f164f1-delete_volume" released by "delete_volume" :: held 4.869s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:23 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-82cedc7c-7e12-461b-aacc-827f9dde67b2" returned: 0 in 1.527s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-82cedc7c-7e12-461b-aacc-827f9dde67b2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:23 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-82cedc7c-7e12-461b-aacc-827f9dde67b2 Jun 25 17:14:23 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:24 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a05a6d8c-37c0-47bd-af05-77c4eca51289" returned: 0 in 1.119s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] Lock "cinder-quobyte-a05a6d8c-37c0-47bd-af05-77c4eca51289" released by "delete_volume" :: held 2.951s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:24 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:24 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] Created reservations ['3b8c9f08-122a-4923-9fdd-0d9b3b8268da', '39402fd6-6a64-460e-b7e5-9241f0f2c0e5', '632d162e-c601-437d-93b9-9c77be905438', 'aadcfc9c-d222-468e-afc5-98f818fe935a'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:14:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a89de173-09f2-4b4a-a5de-d9f3059d04d0" returned: 0 in 1.380s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] Lock "cinder-quobyte-a89de173-09f2-4b4a-a5de-d9f3059d04d0" released by "delete_volume" :: held 3.316s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:14:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:14:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:24 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:14:24 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:24 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] Created reservations ['0f825203-acb4-4f32-86dd-f62e5260d556', 'de059224-376f-44be-8bd3-b716e32e30fd', 'b97e2980-cf06-4530-8c71-544d0e011b7b', '21dde184-1ef6-42fa-b948-0aaa2d10d95e'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:14:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:14:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:14:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:24 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:14:24 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:25 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-82cedc7c-7e12-461b-aacc-827f9dde67b2" returned: 0 in 1.276s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] Lock "cinder-quobyte-82cedc7c-7e12-461b-aacc-827f9dde67b2" released by "delete_volume" :: held 2.900s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:25 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] Created reservations ['53d88509-bd96-4d3f-88e8-c5f7ed86d6f0', '8de1b0fa-7e85-4dd3-88cf-130a29e5f2e4', 'ea62129e-2156-48c0-b8cb-b98e3e77f903', 'dbe4aa13-30b5-4860-bbf4-fd00d9a36c00'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:14:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:14:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:14:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:25 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:14:25 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:25 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.873s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:25 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:14:25 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] Deleted volume successfully. Jun 25 17:14:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f49263cd-70af-4611-b88c-730a46895639 tempest-VolumesCloneNegativeTest-267501402 None] Lock "cinder-a89de173-09f2-4b4a-a5de-d9f3059d04d0-delete_volume" released by "delete_volume" :: held 4.868s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] Acquiring lock "cinder-403e7739-c2d1-42db-8c03-22e304181545-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] Lock "cinder-403e7739-c2d1-42db-8c03-22e304181545-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:26 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.453s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:26 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:14:26 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] Deleted volume successfully. Jun 25 17:14:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] Acquiring lock "cinder-quobyte-403e7739-c2d1-42db-8c03-22e304181545" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8959d879-7031-4da3-ad3c-482fc76025d3 tempest-VolumesTestJSON-1778589856 None] Lock "cinder-a05a6d8c-37c0-47bd-af05-77c4eca51289-delete_volume" released by "delete_volume" :: held 5.157s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] Lock "cinder-quobyte-403e7739-c2d1-42db-8c03-22e304181545" acquired by "delete_volume" :: waited 0.071s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:26 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4135916d-94c5-47fb-b9d3-53de6751397c]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-403e7739-c2d1-42db-8c03-22e304181545 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:26 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-403e7739-c2d1-42db-8c03-22e304181545 Jun 25 17:14:26 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:26 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.246s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:26 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:14:26 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] Deleted volume successfully. Jun 25 17:14:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-87ce97df-430f-4c9b-acc5-454d6f0808ce tempest-VolumesListAdminTestJSON-1693521582 None] Lock "cinder-82cedc7c-7e12-461b-aacc-827f9dde67b2-delete_volume" released by "delete_volume" :: held 4.806s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:27 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-403e7739-c2d1-42db-8c03-22e304181545" returned: 0 in 1.106s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-403e7739-c2d1-42db-8c03-22e304181545 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:27 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-403e7739-c2d1-42db-8c03-22e304181545 Jun 25 17:14:27 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:28 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-403e7739-c2d1-42db-8c03-22e304181545" returned: 0 in 0.849s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:28 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] Lock "cinder-quobyte-403e7739-c2d1-42db-8c03-22e304181545" released by "delete_volume" :: held 2.059s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:28 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] Created reservations ['07cbcd45-b2e7-4ecf-aaae-6589e23cbcfb', '3bd645b5-781c-4c9e-8152-eb7d5be085ce', '95a7b8f6-1037-40dc-820f-54115d05e6f3', '336fed8c-65a9-4707-ae1d-daf160b7905a'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:14:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:14:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:14:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:28 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:14:28 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:29 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.922s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:29 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:14:29 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] Deleted volume successfully. Jun 25 17:14:29 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-67392806-1d50-483c-a025-c93de361d09c tempest-VolumesListAdminTestJSON-1693521582 None] Lock "cinder-403e7739-c2d1-42db-8c03-22e304181545-delete_volume" released by "delete_volume" :: held 3.469s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:14:32 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:14:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Flow 'volume_create_manager' (06aab904-080c-4102-82f4-970a454b1e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:14:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c29c1bb-9c85-47e7-8d6c-2bfea9ebd7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c29c1bb-9c85-47e7-8d6c-2bfea9ebd7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1854677336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9aab613-0340-4baf-b948-cb301e209985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a5016713144aaa92133e149041e769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:14:33Z,use_quota=True,user_id='63b89c45a8b347acb79c6348ff61aee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b53f28a-3708-4a9d-8d83-b1be4adebd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b53f28a-3708-4a9d-8d83-b1be4adebd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbe4c3b-f57c-4a1e-a3d2-097d82fe0847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:33 devstack cinder-volume[93869]: DEBUG cinder.image.glance [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Creating Keystone auth plugin from conf {{(pid=93869) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 17:14:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbe4c3b-f57c-4a1e-a3d2-097d82fe0847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd9aab613-0340-4baf-b948-cb301e209985', 'volume_name': 'volume-d9aab613-0340-4baf-b948-cb301e209985', 'volume_size': 1, 'image_id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5ca37abeabcb4631932d73e3b5ba0213', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'created_at': datetime.datetime(2026, 6, 25, 14, 55, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 14, 55, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee821749-fc82-479d-867e-eb9bd1200c86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30dec556-47d7-4e1b-ba40-d508b9e2e8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30dec556-47d7-4e1b-ba40-d508b9e2e8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb6ea406-1455-4b56-ae86-9598b192b0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:34 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Volume d9aab613-0340-4baf-b948-cb301e209985: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d9aab613-0340-4baf-b948-cb301e209985', 'volume_size': 1, 'image_id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5ca37abeabcb4631932d73e3b5ba0213', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'created_at': datetime.datetime(2026, 6, 25, 14, 55, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 14, 55, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee821749-fc82-479d-867e-eb9bd1200c86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 17:14:34 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Trying to clone d9aab613-0340-4baf-b948-cb301e209985 from image ee821749-fc82-479d-867e-eb9bd1200c86 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}]). {{(pid=93869) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 17:14:35 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_vb0fch5jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 17:14:35 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Image download 20.69 MB at 20.69 MB/s Jun 25 17:14:35 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2485ec0-0ee4-48af-a463-b51ece1da5b5]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_vb0fch5jdevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:35 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_vb0fch5jdevstack@QuobyteHD Jun 25 17:14:35 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:35 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_vb0fch5jdevstack@QuobyteHD" returned: 0 in 0.770s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:35 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Temporary image ee821749-fc82-479d-867e-eb9bd1200c86 is fetched for user 63b89c45a8b347acb79c6348ff61aee6. {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 17:14:37 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b254de3-aacc-422e-b02d-8409cca183b4]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_vb0fch5jdevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:37 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_vb0fch5jdevstack@QuobyteHD Jun 25 17:14:37 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:38 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_vb0fch5jdevstack@QuobyteHD" returned: 0 in 1.001s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1854677336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9aab613-0340-4baf-b948-cb301e209985,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a5016713144aaa92133e149041e769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:14:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:14:33Z,use_quota=True,user_id='63b89c45a8b347acb79c6348ff61aee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:14:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Creating volume d9aab613-0340-4baf-b948-cb301e209985 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:14:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:14:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:14:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:14:38 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:14:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:38 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 1073741824 Jun 25 17:14:38 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:40 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 1073741824" returned: 0 in 1.378s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:40 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 Jun 25 17:14:40 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:41 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985" returned: 0 in 1.177s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] <== create_volume: return (2636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:14:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.641s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:41 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Attempting download of ee821749-fc82-479d-867e-eb9bd1200c86 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}])) to volume d9aab613-0340-4baf-b948-cb301e209985. {{(pid=93869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 17:14:41 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cea6a05-c5cb-462e-a3bb-374dcaa80c5b]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_0e5cc8zj {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:41 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_0e5cc8zj Jun 25 17:14:41 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:42 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_0e5cc8zj" returned: 0 in 1.188s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_0e5cc8zj {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:42 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_0e5cc8zj Jun 25 17:14:42 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:43 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_0e5cc8zj" returned: 1 in 1.181s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_0e5cc8zj' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:14:43 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c915104-a6d3-4ce2-a506-b106f33d98a1]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_vb0fch5jdevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=78,cinder:UPDATE=108,cinder:INSERT=20,cinder:DELETE=10 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=114,cinder:INSERT=31,cinder:DELETE=9,cinder:SELECT=77 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:14:44 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_vb0fch5jdevstack@QuobyteHD Jun 25 17:14:44 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Flow 'volume_create_manager' (06a967c0-87e9-4d73-9677-1b6129fffcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e562af75-b493-4e3e-85f4-6e4cd9fbbad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:44 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:14:44 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e562af75-b493-4e3e-85f4-6e4cd9fbbad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1123994354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ea15d7-e329-4555-84e0-e97d89db5bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986bc9d3bc204878a270542e46892d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:14:44Z,use_quota=True,user_id='e531d8e850b9429b90799712934ec891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6a2776-cead-4eb6-b478-662e41184cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6a2776-cead-4eb6-b478-662e41184cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad36e2ba-3520-40be-905e-8b5de1a695ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG cinder.image.glance [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Creating Keystone auth plugin from conf {{(pid=93869) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad36e2ba-3520-40be-905e-8b5de1a695ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd1ea15d7-e329-4555-84e0-e97d89db5bb4', 'volume_name': 'volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4', 'volume_size': 1, 'image_id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5ca37abeabcb4631932d73e3b5ba0213', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'created_at': datetime.datetime(2026, 6, 25, 14, 55, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 14, 55, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee821749-fc82-479d-867e-eb9bd1200c86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9269a4-2de4-43f7-bbde-1cb587902232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d9269a4-2de4-43f7-bbde-1cb587902232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041ff97f-f181-49dd-b5d9-4286fc0484d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:44 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Volume d1ea15d7-e329-4555-84e0-e97d89db5bb4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4', 'volume_size': 1, 'image_id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5ca37abeabcb4631932d73e3b5ba0213', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'created_at': datetime.datetime(2026, 6, 25, 14, 55, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 14, 55, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee821749-fc82-479d-867e-eb9bd1200c86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 17:14:44 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Trying to clone d1ea15d7-e329-4555-84e0-e97d89db5bb4 from image ee821749-fc82-479d-867e-eb9bd1200c86 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}]). {{(pid=93869) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 17:14:45 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_vb0fch5jdevstack@QuobyteHD" returned: 0 in 1.307s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:45 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] ee821749-fc82-479d-867e-eb9bd1200c86 was qcow2, converting to raw {{(pid=93869) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 17:14:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_vb0fch5jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:45 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_vb0fch5jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 Jun 25 17:14:45 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:45 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_g2epsepndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 17:14:45 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Image download 20.69 MB at 20.69 MB/s Jun 25 17:14:45 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.328s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:14:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:14:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 28 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:14:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:14:45 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da59b62-8d55-40de-9d65-e4794359491d]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_g2epsepndevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:45 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_g2epsepndevstack@QuobyteHD Jun 25 17:14:45 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:46 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_g2epsepndevstack@QuobyteHD" returned: 0 in 1.061s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:46 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Temporary image ee821749-fc82-479d-867e-eb9bd1200c86 is fetched for user e531d8e850b9429b90799712934ec891. {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 17:14:46 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5d35b5-6774-49bc-badd-0ff5393a6661]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_g2epsepndevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:47 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_g2epsepndevstack@QuobyteHD Jun 25 17:14:47 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_g2epsepndevstack@QuobyteHD" returned: 0 in 1.200s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:48 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1123994354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ea15d7-e329-4555-84e0-e97d89db5bb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986bc9d3bc204878a270542e46892d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:14:44Z,use_quota=True,user_id='e531d8e850b9429b90799712934ec891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:14:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Creating volume d1ea15d7-e329-4555-84e0-e97d89db5bb4 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:14:48 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 1073741824 Jun 25 17:14:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:14:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:14:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:48 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:14:48 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:14:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:48 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_vb0fch5jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985" returned: 0 in 3.321s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:48 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_vb0fch5jdevstack@QuobyteHD, size 112.00 MB, duration 3.32 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:14:48 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Converted 112.00 MB image at 33.69 MB/s Jun 25 17:14:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:48 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 1G Jun 25 17:14:48 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:49 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 1073741824" returned: 0 in 1.589s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:49 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 Jun 25 17:14:49 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:49 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 1G" returned: 0 in 1.187s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:49 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d8f6f8-e8d4-46b7-aa63-1a9238fc6b59]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:49 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 Jun 25 17:14:49 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:50 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4" returned: 0 in 0.917s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] <== create_volume: return (2589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:14:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.595s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:50 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Attempting download of ee821749-fc82-479d-867e-eb9bd1200c86 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}])) to volume d1ea15d7-e329-4555-84e0-e97d89db5bb4. {{(pid=93869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 17:14:50 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1ccc40-db31-419a-bdb8-507b4869ee58]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_xetbcan9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:50 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_xetbcan9 Jun 25 17:14:50 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:50 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985" returned: 0 in 1.143s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:51 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 Jun 25 17:14:51 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:51 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_xetbcan9" returned: 0 in 1.076s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_xetbcan9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:52 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_xetbcan9 Jun 25 17:14:52 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:52 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985" returned: 1 in 1.173s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:14:52 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Downloaded image ee821749-fc82-479d-867e-eb9bd1200c86 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}])) to volume d9aab613-0340-4baf-b948-cb301e209985 successfully. {{(pid=93869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 17:14:52 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Temporary image ee821749-fc82-479d-867e-eb9bd1200c86 for user 63b89c45a8b347acb79c6348ff61aee6 is deleted. {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 17:14:52 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Marking volume d9aab613-0340-4baf-b948-cb301e209985 as bootable. {{(pid=93869) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 17:14:52 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Copying metadata from image ee821749-fc82-479d-867e-eb9bd1200c86 to d9aab613-0340-4baf-b948-cb301e209985. {{(pid=93869) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 17:14:52 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Creating volume glance metadata for volume d9aab613-0340-4baf-b948-cb301e209985 backed by image ee821749-fc82-479d-867e-eb9bd1200c86 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93869) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 17:14:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb6ea406-1455-4b56-ae86-9598b192b0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9aab613-0340-4baf-b948-cb301e209985', 'volume_size': 1, 'image_id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5ca37abeabcb4631932d73e3b5ba0213', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'created_at': datetime.datetime(2026, 6, 25, 14, 55, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 14, 55, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee821749-fc82-479d-867e-eb9bd1200c86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62dbc92c-cd38-437b-9a79-5c176880785a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:14:52 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Volume volume-d9aab613-0340-4baf-b948-cb301e209985 (d9aab613-0340-4baf-b948-cb301e209985): created successfully Jun 25 17:14:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62dbc92c-cd38-437b-9a79-5c176880785a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:14:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Flow 'volume_create_manager' (06aab904-080c-4102-82f4-970a454b1e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:14:52 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-51fe5a92-f991-42ed-b730-87271f1ce428 tempest-VolumesExtendTest-1244819833 None] Created volume successfully. Jun 25 17:14:52 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_xetbcan9" returned: 1 in 0.921s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_xetbcan9' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:14:52 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee8cb7c-5c17-4205-9376-d23dd3e8ca06]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_g2epsepndevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-63054432-0029-4e2b-a090-87cd81b07d02 tempest-VolumesExtendTest-1244819833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:14:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-63054432-0029-4e2b-a090-87cd81b07d02 tempest-VolumesExtendTest-1244819833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:14:52 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[24be9421-af09-4c7a-b23a-aadbc7fd648d]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-63054432-0029-4e2b-a090-87cd81b07d02 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:52 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_g2epsepndevstack@QuobyteHD Jun 25 17:14:52 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:53 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 Jun 25 17:14:53 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:53 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_g2epsepndevstack@QuobyteHD" returned: 0 in 0.960s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:53 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] ee821749-fc82-479d-867e-eb9bd1200c86 was qcow2, converting to raw {{(pid=93869) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 17:14:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_g2epsepndevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:53 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_g2epsepndevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 Jun 25 17:14:53 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:53 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-63054432-0029-4e2b-a090-87cd81b07d02 tempest-VolumesExtendTest-1244819833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985" returned: 0 in 1.090s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-63054432-0029-4e2b-a090-87cd81b07d02 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:54 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 Jun 25 17:14:54 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:55 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-63054432-0029-4e2b-a090-87cd81b07d02 tempest-VolumesExtendTest-1244819833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985" returned: 1 in 1.420s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-63054432-0029-4e2b-a090-87cd81b07d02 tempest-VolumesExtendTest-1244819833 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:14:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-63054432-0029-4e2b-a090-87cd81b07d02 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 2G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-63054432-0029-4e2b-a090-87cd81b07d02 tempest-VolumesExtendTest-1244819833 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 2G" returned: 0 in 0.098s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-63054432-0029-4e2b-a090-87cd81b07d02 tempest-VolumesExtendTest-1244819833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.680s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:14:55 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-63054432-0029-4e2b-a090-87cd81b07d02 tempest-VolumesExtendTest-1244819833 None] Extend volume completed successfully. Jun 25 17:14:56 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] Acquiring lock "cinder-d9aab613-0340-4baf-b948-cb301e209985-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:56 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] Lock "cinder-d9aab613-0340-4baf-b948-cb301e209985-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:56 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] Acquiring lock "cinder-quobyte-d9aab613-0340-4baf-b948-cb301e209985" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:14:56 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] Lock "cinder-quobyte-d9aab613-0340-4baf-b948-cb301e209985" acquired by "delete_volume" :: waited 0.026s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:14:56 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d818d48-0368-41be-8aec-4e3556eabb6f]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:56 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_g2epsepndevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4" returned: 0 in 3.238s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:56 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_g2epsepndevstack@QuobyteHD, size 112.00 MB, duration 3.24 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:14:56 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Converted 112.00 MB image at 34.55 MB/s Jun 25 17:14:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:56 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 Jun 25 17:14:56 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:57 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 1G Jun 25 17:14:57 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:58 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985" returned: 0 in 1.234s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:58 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 1G" returned: 0 in 1.200s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:58 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67e6d31-23ef-4572-adf1-33227623052f]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:14:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:58 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 Jun 25 17:14:58 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:58 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 Jun 25 17:14:58 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:59 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4" returned: 0 in 1.217s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:59 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Jun 25 17:14:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985" returned: 1 in 1.418s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:14:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:14:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:14:59 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985 Jun 25 17:14:59 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:14:59 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 Jun 25 17:14:59 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:00 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9aab613-0340-4baf-b948-cb301e209985" returned: 0 in 0.996s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] Lock "cinder-quobyte-d9aab613-0340-4baf-b948-cb301e209985" released by "delete_volume" :: held 3.747s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:00 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4" returned: 1 in 1.140s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Downloaded image ee821749-fc82-479d-867e-eb9bd1200c86 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}])) to volume d1ea15d7-e329-4555-84e0-e97d89db5bb4 successfully. {{(pid=93869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Temporary image ee821749-fc82-479d-867e-eb9bd1200c86 for user e531d8e850b9429b90799712934ec891 is deleted. {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Marking volume d1ea15d7-e329-4555-84e0-e97d89db5bb4 as bootable. {{(pid=93869) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] Created reservations ['82ae209a-b053-4bac-969c-fbe99691284c', '958ad957-9ad0-47c5-b333-dc23607f9689', '5d6102b6-e8d7-4e33-8762-ab37416fe156', '20815235-b39f-4e9a-b9ce-100f88670f03'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Copying metadata from image ee821749-fc82-479d-867e-eb9bd1200c86 to d1ea15d7-e329-4555-84e0-e97d89db5bb4. {{(pid=93869) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Creating volume glance metadata for volume d1ea15d7-e329-4555-84e0-e97d89db5bb4 backed by image ee821749-fc82-479d-867e-eb9bd1200c86 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93869) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:00 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:15:00 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (041ff97f-f181-49dd-b5d9-4286fc0484d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4', 'volume_size': 1, 'image_id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5ca37abeabcb4631932d73e3b5ba0213', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'created_at': datetime.datetime(2026, 6, 25, 14, 55, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 14, 55, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee821749-fc82-479d-867e-eb9bd1200c86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ac5549-f2c5-4c1d-804b-e0c18d29c744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:00 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Volume volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 (d1ea15d7-e329-4555-84e0-e97d89db5bb4): created successfully Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44ac5549-f2c5-4c1d-804b-e0c18d29c744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Flow 'volume_create_manager' (06a967c0-87e9-4d73-9677-1b6129fffcdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:15:00 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b402b6fe-463e-4550-8825-811b01423d6a tempest-VolumesImageMetadata-1431517665 None] Created volume successfully. Jun 25 17:15:01 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.038s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:01 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:15:01 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] Deleted volume successfully. Jun 25 17:15:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-520e7246-3aa7-4d4d-a607-27007cded8ad tempest-VolumesExtendTest-1244819833 None] Lock "cinder-d9aab613-0340-4baf-b948-cb301e209985-delete_volume" released by "delete_volume" :: held 5.212s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Flow 'volume_create_manager' (f3676973-6d51-4a89-8317-170b40e1a8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee20ec8-6a46-44c9-a501-8207ebaf2948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee20ec8-6a46-44c9-a501-8207ebaf2948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2022967949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afddaca8-4a4c-4cca-8592-28c72c2ee4b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a5016713144aaa92133e149041e769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:15:02Z,use_quota=True,user_id='63b89c45a8b347acb79c6348ff61aee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ccdf15-406a-433f-ad10-929d13985fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ccdf15-406a-433f-ad10-929d13985fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d17ffd-60b0-4e25-ad89-d8cf5fe4c48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28d17ffd-60b0-4e25-ad89-d8cf5fe4c48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afddaca8-4a4c-4cca-8592-28c72c2ee4b8', 'volume_name': 'volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a241dc9b-9234-456d-b6d6-2adc1ce1d2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a241dc9b-9234-456d-b6d6-2adc1ce1d2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d27d8c3-27b5-47bc-ab1a-0ec915119457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:02 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Volume afddaca8-4a4c-4cca-8592-28c72c2ee4b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8', 'volume_size': 1} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2022967949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afddaca8-4a4c-4cca-8592-28c72c2ee4b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36a5016713144aaa92133e149041e769',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:15:02Z,use_quota=True,user_id='63b89c45a8b347acb79c6348ff61aee6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Creating volume afddaca8-4a4c-4cca-8592-28c72c2ee4b8 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:15:02 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:02 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8 1073741824 Jun 25 17:15:02 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] Acquiring lock "cinder-d1ea15d7-e329-4555-84e0-e97d89db5bb4-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] Lock "cinder-d1ea15d7-e329-4555-84e0-e97d89db5bb4-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] Acquiring lock "cinder-quobyte-d1ea15d7-e329-4555-84e0-e97d89db5bb4" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] Lock "cinder-quobyte-d1ea15d7-e329-4555-84e0-e97d89db5bb4" acquired by "delete_volume" :: waited 0.037s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:03 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e803ac-a6de-4376-9054-a4030f008296]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:15:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:03 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 Jun 25 17:15:03 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:04 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8 1073741824" returned: 0 in 1.705s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:04 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:15:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Flow 'volume_create_manager' (cf5beaf9-ae2c-44a3-b8fc-86a943422db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:15:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85262d3-c494-46e9-afc2-fa08fa7a2eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85262d3-c494-46e9-afc2-fa08fa7a2eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1432334448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03208b28-3544-44c8-9684-fafb19daec1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb5e1da664d242aca52849da8e4b8b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:15:04Z,use_quota=True,user_id='3c26a3148cc0492e942554da47ab7316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4da0d33-8cf2-4332-a93e-fa3a11b45bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4da0d33-8cf2-4332-a93e-fa3a11b45bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:04 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c91842a-d274-4a34-b39d-b2addeec6f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c91842a-d274-4a34-b39d-b2addeec6f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03208b28-3544-44c8-9684-fafb19daec1c', 'volume_name': 'volume-03208b28-3544-44c8-9684-fafb19daec1c', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c451cebe-78b4-45d5-af54-54a998b98dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c451cebe-78b4-45d5-af54-54a998b98dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d383c8-f999-464b-8670-fcc13f8c4f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:04 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Volume 03208b28-3544-44c8-9684-fafb19daec1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03208b28-3544-44c8-9684-fafb19daec1c', 'volume_size': 1} Jun 25 17:15:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4" returned: 0 in 1.205s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:04 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8 Jun 25 17:15:04 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:04 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 Jun 25 17:15:04 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:05 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8" returned: 0 in 1.246s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] <== create_volume: return (3185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.190s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.259s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1432334448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03208b28-3544-44c8-9684-fafb19daec1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb5e1da664d242aca52849da8e4b8b59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:15:04Z,use_quota=True,user_id='3c26a3148cc0492e942554da47ab7316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Creating volume 03208b28-3544-44c8-9684-fafb19daec1c {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:15:05 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:05 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4" returned: 1 in 1.286s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:05 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c 1073741824 Jun 25 17:15:05 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:05 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4 Jun 25 17:15:05 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d27d8c3-27b5-47bc-ab1a-0ec915119457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afd8bfc-dd65-4b50-94bc-b4278cbe1889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:05 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Volume volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8 (afddaca8-4a4c-4cca-8592-28c72c2ee4b8): created successfully Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4afd8bfc-dd65-4b50-94bc-b4278cbe1889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Flow 'volume_create_manager' (f3676973-6d51-4a89-8317-170b40e1a8ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:15:05 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-84f17a6c-0fff-493a-bac2-3ef51f049802 tempest-VolumesExtendTest-1244819833 None] Created volume successfully. Jun 25 17:15:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-37890a00-3a8f-4d52-8430-d514315621d9 tempest-VolumesExtendTest-1244819833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:06 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d1ea15d7-e329-4555-84e0-e97d89db5bb4" returned: 0 in 1.281s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] Lock "cinder-quobyte-d1ea15d7-e329-4555-84e0-e97d89db5bb4" released by "delete_volume" :: held 3.918s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:07 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] Created reservations ['1e9bddb8-a6bc-4ee4-b688-794456739b70', 'fddd9cc1-c8ac-4f16-9691-e796365a55cb', '9f71c770-22ab-47fb-8bd8-d36f478283c0', '6c8c6450-0ad3-4b12-aa82-d6c8b43e1ea5'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:15:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:15:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:15:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:07 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c 1073741824" returned: 0 in 1.630s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:07 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:15:07 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:07 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c Jun 25 17:15:07 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:08 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.290s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:08 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:15:08 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] Deleted volume successfully. Jun 25 17:15:08 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6bba4629-0582-455a-8d06-549a04b78e4f tempest-VolumesImageMetadata-1431517665 None] Lock "cinder-d1ea15d7-e329-4555-84e0-e97d89db5bb4-delete_volume" released by "delete_volume" :: held 5.634s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:08 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c" returned: 0 in 1.231s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:08 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] <== create_volume: return (2964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:15:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.969s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-37890a00-3a8f-4d52-8430-d514315621d9 tempest-VolumesExtendTest-1244819833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.713s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:08 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-37890a00-3a8f-4d52-8430-d514315621d9 tempest-VolumesExtendTest-1244819833 None] Creating offline snapshot 45dd6277-66ac-476c-9873-7582bce40d72 of volume afddaca8-4a4c-4cca-8592-28c72c2ee4b8 {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:15:08 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d383c8-f999-464b-8670-fcc13f8c4f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03208b28-3544-44c8-9684-fafb19daec1c', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:08 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3297c584-ffef-4bf7-b872-a86ed35df7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:08 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00d3aab-8327-469f-b2b5-59372456112b]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:15:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-37890a00-3a8f-4d52-8430-d514315621d9 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:08 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Volume volume-03208b28-3544-44c8-9684-fafb19daec1c (03208b28-3544-44c8-9684-fafb19daec1c): created successfully Jun 25 17:15:08 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3297c584-ffef-4bf7-b872-a86ed35df7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:08 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Flow 'volume_create_manager' (cf5beaf9-ae2c-44a3-b8fc-86a943422db0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:15:08 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-469fcf79-2760-4600-8bf5-efe17e4f5232 tempest-SnapshotsActionsTest-714163679 None] Created volume successfully. Jun 25 17:15:08 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8 Jun 25 17:15:08 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:09 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-37890a00-3a8f-4d52-8430-d514315621d9 tempest-VolumesExtendTest-1244819833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8" returned: 0 in 1.007s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-37890a00-3a8f-4d52-8430-d514315621d9 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:09 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72 1G Jun 25 17:15:09 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-86c39f86-f985-482f-89e4-37d4e616edf2 tempest-SnapshotsActionsTest-714163679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:10 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-37890a00-3a8f-4d52-8430-d514315621d9 tempest-VolumesExtendTest-1244819833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72 1G" returned: 0 in 1.309s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-37890a00-3a8f-4d52-8430-d514315621d9 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:10 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72 Jun 25 17:15:10 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:12 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-37890a00-3a8f-4d52-8430-d514315621d9 tempest-VolumesExtendTest-1244819833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72" returned: 0 in 1.084s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:12 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-37890a00-3a8f-4d52-8430-d514315621d9 tempest-VolumesExtendTest-1244819833 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72 is being set with open permissions: ugo+rw Jun 25 17:15:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-37890a00-3a8f-4d52-8430-d514315621d9 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:12 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72 Jun 25 17:15:12 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:12 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-37890a00-3a8f-4d52-8430-d514315621d9 tempest-VolumesExtendTest-1244819833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72" returned: 0 in 0.817s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-37890a00-3a8f-4d52-8430-d514315621d9 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:12 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.info Jun 25 17:15:12 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:13 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-37890a00-3a8f-4d52-8430-d514315621d9 tempest-VolumesExtendTest-1244819833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.info" returned: 0 in 0.869s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:13 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-37890a00-3a8f-4d52-8430-d514315621d9 tempest-VolumesExtendTest-1244819833 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.info is being set with open permissions: ugo+rw Jun 25 17:15:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-37890a00-3a8f-4d52-8430-d514315621d9 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:13 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.info Jun 25 17:15:13 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:14 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:15:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Flow 'volume_create_manager' (89801fad-a9c2-4543-9983-b085c66f99ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:15:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a2d6e1-3e4a-4a93-bb2d-13b6b80ad936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79a2d6e1-3e4a-4a93-bb2d-13b6b80ad936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1891428744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66336a52-eab8-4888-a669-382e02a9018d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4123c0e61044d2b46ef40eee98d95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:15:14Z,use_quota=True,user_id='ad2c54996a7b47679f7339d70c20aca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f590e5-6554-4122-aaab-990936620b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91f590e5-6554-4122-aaab-990936620b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9caf0550-29b5-4b66-b6da-4a8773a29d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9caf0550-29b5-4b66-b6da-4a8773a29d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66336a52-eab8-4888-a669-382e02a9018d', 'volume_name': 'volume-66336a52-eab8-4888-a669-382e02a9018d', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e63b4ac-47a9-4390-b59a-a614f909c42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e63b4ac-47a9-4390-b59a-a614f909c42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0ec8fc-241f-40e1-aed6-9769c3b3acb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:14 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Volume 66336a52-eab8-4888-a669-382e02a9018d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66336a52-eab8-4888-a669-382e02a9018d', 'volume_size': 1} Jun 25 17:15:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:14 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-37890a00-3a8f-4d52-8430-d514315621d9 tempest-VolumesExtendTest-1244819833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.info" returned: 0 in 0.856s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-37890a00-3a8f-4d52-8430-d514315621d9 tempest-VolumesExtendTest-1244819833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.080s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-86c39f86-f985-482f-89e4-37d4e616edf2 tempest-SnapshotsActionsTest-714163679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.544s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-86c39f86-f985-482f-89e4-37d4e616edf2 tempest-SnapshotsActionsTest-714163679 None] Creating offline snapshot 8f06541d-3e60-4689-bcda-877b80468fe2 of volume 03208b28-3544-44c8-9684-fafb19daec1c {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:15:14 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-37890a00-3a8f-4d52-8430-d514315621d9 tempest-VolumesExtendTest-1244819833 None] Create snapshot completed successfully Jun 25 17:15:14 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b86a8e-f56b-4133-b491-a426d1d0ef4a]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:15:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-86c39f86-f985-482f-89e4-37d4e616edf2 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:14 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c Jun 25 17:15:14 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-66b53b73-02ea-4ac0-86bb-b662427965a0 tempest-VolumesExtendTest-1244819833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:15 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-86c39f86-f985-482f-89e4-37d4e616edf2 tempest-SnapshotsActionsTest-714163679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c" returned: 0 in 1.004s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-86c39f86-f985-482f-89e4-37d4e616edf2 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:15 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 1G Jun 25 17:15:15 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:16 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-86c39f86-f985-482f-89e4-37d4e616edf2 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 1G" returned: 0 in 1.192s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-86c39f86-f985-482f-89e4-37d4e616edf2 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03208b28-3544-44c8-9684-fafb19daec1c -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:16 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03208b28-3544-44c8-9684-fafb19daec1c -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 Jun 25 17:15:16 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:17 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-86c39f86-f985-482f-89e4-37d4e616edf2 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03208b28-3544-44c8-9684-fafb19daec1c -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2" returned: 0 in 0.953s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:17 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-86c39f86-f985-482f-89e4-37d4e616edf2 tempest-SnapshotsActionsTest-714163679 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 is being set with open permissions: ugo+rw Jun 25 17:15:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-86c39f86-f985-482f-89e4-37d4e616edf2 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:17 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 Jun 25 17:15:17 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:18 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-86c39f86-f985-482f-89e4-37d4e616edf2 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2" returned: 0 in 0.950s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-86c39f86-f985-482f-89e4-37d4e616edf2 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:18 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.info Jun 25 17:15:18 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:19 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-86c39f86-f985-482f-89e4-37d4e616edf2 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.info" returned: 0 in 0.891s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:19 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-86c39f86-f985-482f-89e4-37d4e616edf2 tempest-SnapshotsActionsTest-714163679 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.info is being set with open permissions: ugo+rw Jun 25 17:15:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-86c39f86-f985-482f-89e4-37d4e616edf2 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:19 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.info Jun 25 17:15:19 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:20 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-86c39f86-f985-482f-89e4-37d4e616edf2 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.info" returned: 0 in 0.898s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-86c39f86-f985-482f-89e4-37d4e616edf2 tempest-SnapshotsActionsTest-714163679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.035s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.591s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1891428744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66336a52-eab8-4888-a669-382e02a9018d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f4123c0e61044d2b46ef40eee98d95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:15:14Z,use_quota=True,user_id='ad2c54996a7b47679f7339d70c20aca0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:15:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Creating volume 66336a52-eab8-4888-a669-382e02a9018d {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:15:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:15:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:15:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:15:20 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:15:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-66336a52-eab8-4888-a669-382e02a9018d 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:20 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-66336a52-eab8-4888-a669-382e02a9018d 1073741824 Jun 25 17:15:20 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:20 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-86c39f86-f985-482f-89e4-37d4e616edf2 tempest-SnapshotsActionsTest-714163679 None] Create snapshot completed successfully Jun 25 17:15:21 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-66336a52-eab8-4888-a669-382e02a9018d 1073741824" returned: 0 in 1.206s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-66336a52-eab8-4888-a669-382e02a9018d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:22 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-66336a52-eab8-4888-a669-382e02a9018d Jun 25 17:15:22 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-60759ee3-bd5b-4e33-9880-b31d8d1e3eac tempest-SnapshotsActionsTest-714163679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:23 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-66336a52-eab8-4888-a669-382e02a9018d" returned: 0 in 1.196s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] <== create_volume: return (2483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:15:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.489s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-66b53b73-02ea-4ac0-86bb-b662427965a0 tempest-VolumesExtendTest-1244819833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 7.556s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:23 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a256a35-9cea-4c63-addd-6ac21a9696e6]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:15:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-66b53b73-02ea-4ac0-86bb-b662427965a0 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:23 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd0ec8fc-241f-40e1-aed6-9769c3b3acb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66336a52-eab8-4888-a669-382e02a9018d', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:23 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26ad0a6-52a4-4500-94cf-c21e63f29824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:23 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Volume volume-66336a52-eab8-4888-a669-382e02a9018d (66336a52-eab8-4888-a669-382e02a9018d): created successfully Jun 25 17:15:23 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26ad0a6-52a4-4500-94cf-c21e63f29824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:23 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Flow 'volume_create_manager' (89801fad-a9c2-4543-9983-b085c66f99ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:15:23 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-40f5c454-dbe4-4aef-a7ce-d5af93ed838e tempest-AbsoluteLimitsTests-69325257 None] Created volume successfully. Jun 25 17:15:23 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8 Jun 25 17:15:23 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] Acquiring lock "cinder-66336a52-eab8-4888-a669-382e02a9018d-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] Lock "cinder-66336a52-eab8-4888-a669-382e02a9018d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] Acquiring lock "cinder-quobyte-66336a52-eab8-4888-a669-382e02a9018d" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] Lock "cinder-quobyte-66336a52-eab8-4888-a669-382e02a9018d" acquired by "delete_volume" :: waited 0.026s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:24 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9adc2da-9b0e-4f7d-afa8-a4820be05498]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:15:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-66336a52-eab8-4888-a669-382e02a9018d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:24 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-66b53b73-02ea-4ac0-86bb-b662427965a0 tempest-VolumesExtendTest-1244819833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8" returned: 0 in 1.131s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-66b53b73-02ea-4ac0-86bb-b662427965a0 tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72 2G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:24 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-66336a52-eab8-4888-a669-382e02a9018d Jun 25 17:15:24 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-66b53b73-02ea-4ac0-86bb-b662427965a0 tempest-VolumesExtendTest-1244819833 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72 2G" returned: 0 in 0.214s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-66b53b73-02ea-4ac0-86bb-b662427965a0 tempest-VolumesExtendTest-1244819833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.405s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-60759ee3-bd5b-4e33-9880-b31d8d1e3eac tempest-SnapshotsActionsTest-714163679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.859s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-60759ee3-bd5b-4e33-9880-b31d8d1e3eac tempest-SnapshotsActionsTest-714163679 None] Creating offline snapshot a68b0542-6288-4486-8407-a00a9ad59840 of volume 03208b28-3544-44c8-9684-fafb19daec1c {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:15:24 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[9263f104-5e85-44b1-a699-fb60f3dd8e43]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:15:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-60759ee3-bd5b-4e33-9880-b31d8d1e3eac tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:24 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-66b53b73-02ea-4ac0-86bb-b662427965a0 tempest-VolumesExtendTest-1244819833 None] Extend volume completed successfully. Jun 25 17:15:24 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 Jun 25 17:15:24 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:25 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-66336a52-eab8-4888-a669-382e02a9018d" returned: 0 in 1.169s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-66336a52-eab8-4888-a669-382e02a9018d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:25 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-66336a52-eab8-4888-a669-382e02a9018d Jun 25 17:15:25 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] Acquiring lock "cinder-45dd6277-66ac-476c-9873-7582bce40d72-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] Lock "cinder-45dd6277-66ac-476c-9873-7582bce40d72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] Acquiring lock "cinder-quobyte-afddaca8-4a4c-4cca-8592-28c72c2ee4b8" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] Lock "cinder-quobyte-afddaca8-4a4c-4cca-8592-28c72c2ee4b8" acquired by "delete_snapshot" :: waited 0.045s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] Acquiring lock "cinder-quobyte-45dd6277-66ac-476c-9873-7582bce40d72" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:26 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-60759ee3-bd5b-4e33-9880-b31d8d1e3eac tempest-SnapshotsActionsTest-714163679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2" returned: 0 in 1.291s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-60759ee3-bd5b-4e33-9880-b31d8d1e3eac tempest-SnapshotsActionsTest-714163679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03208b28-3544-44c8-9684-fafb19daec1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-60759ee3-bd5b-4e33-9880-b31d8d1e3eac tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] Lock "cinder-quobyte-45dd6277-66ac-476c-9873-7582bce40d72" acquired by "_delete_snapshot" :: waited 0.065s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] Deleting offline snapshot 45dd6277-66ac-476c-9873-7582bce40d72 of volume afddaca8-4a4c-4cca-8592-28c72c2ee4b8 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:15:26 devstack sudo[105672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840 1G Jun 25 17:15:26 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] snapshot_file for this snap is: volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0523d4-f0fe-4031-85ea-e3d88a0cc8b5]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:15:26 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72 Jun 25 17:15:26 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Flow 'volume_create_manager' (d018a139-7bc5-42fe-b2e4-9f1f9415f80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a52a061-2217-4cbe-ab4d-0a124fbf3bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a52a061-2217-4cbe-ab4d-0a124fbf3bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-864206536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596b3594-2fa6-4d27-9dd4-14c6bc466de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='583e61b1188d4209a862b08de13846a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:15:26Z,use_quota=True,user_id='62179633b723445e8a191994e2dccea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454b9436-8d63-4aba-b7b8-095c48ab85a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (454b9436-8d63-4aba-b7b8-095c48ab85a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612d6da0-e956-4493-b0f9-1e2dab03e519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612d6da0-e956-4493-b0f9-1e2dab03e519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '596b3594-2fa6-4d27-9dd4-14c6bc466de5', 'volume_name': 'volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e1ad0b-fb79-4ed2-aa1c-0dbb91a65e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e1ad0b-fb79-4ed2-aa1c-0dbb91a65e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c3eab6-22d4-454c-bacb-6b3e39b63b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:26 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Volume 596b3594-2fa6-4d27-9dd4-14c6bc466de5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5', 'volume_size': 1} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:26 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-66336a52-eab8-4888-a669-382e02a9018d" returned: 0 in 1.277s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] Lock "cinder-quobyte-66336a52-eab8-4888-a669-382e02a9018d" released by "delete_volume" :: held 2.512s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] Created reservations ['f56f2bc0-61a3-4f47-8fdc-10f302f9cd0d', '5c32f418-00e3-485d-9aa7-4f92a446d67f', '0f8b1af4-cd5a-436c-bacd-a5d54d788118', 'b09bc071-3d75-4c0d-8729-2cbc5a2f0282'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:26 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:15:26 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:27 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72" returned: 0 in 1.292s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:15:27 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f25b170-d509-4145-a284-461dc23d4630]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:15:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:27 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-60759ee3-bd5b-4e33-9880-b31d8d1e3eac tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840 1G" returned: 0 in 1.538s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-60759ee3-bd5b-4e33-9880-b31d8d1e3eac tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:27 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840 Jun 25 17:15:27 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:27 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8 Jun 25 17:15:27 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:28 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.224s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:28 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:15:28 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] Deleted volume successfully. Jun 25 17:15:28 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-70ccee13-0acd-4d04-a83e-4aabe6b51d48 tempest-AbsoluteLimitsTests-69325257 None] Lock "cinder-66336a52-eab8-4888-a669-382e02a9018d-delete_volume" released by "delete_volume" :: held 4.145s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:28 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8" returned: 0 in 1.263s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:28 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-60759ee3-bd5b-4e33-9880-b31d8d1e3eac tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840" returned: 0 in 1.235s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:28 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-60759ee3-bd5b-4e33-9880-b31d8d1e3eac tempest-SnapshotsActionsTest-714163679 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840 is being set with open permissions: ugo+rw Jun 25 17:15:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-60759ee3-bd5b-4e33-9880-b31d8d1e3eac tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:28 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72 Jun 25 17:15:28 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:28 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840 Jun 25 17:15:28 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:29 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-60759ee3-bd5b-4e33-9880-b31d8d1e3eac tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840" returned: 0 in 1.172s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-60759ee3-bd5b-4e33-9880-b31d8d1e3eac tempest-SnapshotsActionsTest-714163679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.433s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.444s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-864206536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=596b3594-2fa6-4d27-9dd4-14c6bc466de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='583e61b1188d4209a862b08de13846a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:15:26Z,use_quota=True,user_id='62179633b723445e8a191994e2dccea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Creating volume 596b3594-2fa6-4d27-9dd4-14c6bc466de5 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:15:30 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:30 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 1073741824 Jun 25 17:15:30 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:30 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:30 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-60759ee3-bd5b-4e33-9880-b31d8d1e3eac tempest-SnapshotsActionsTest-714163679 None] Create snapshot completed successfully Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72" returned: 0 in 1.353s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:30 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72 Jun 25 17:15:30 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] Acquiring lock "cinder-a68b0542-6288-4486-8407-a00a9ad59840-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-a68b0542-6288-4486-8407-a00a9ad59840-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] Acquiring lock "cinder-quobyte-03208b28-3544-44c8-9684-fafb19daec1c" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-quobyte-03208b28-3544-44c8-9684-fafb19daec1c" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] Acquiring lock "cinder-quobyte-a68b0542-6288-4486-8407-a00a9ad59840" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-quobyte-a68b0542-6288-4486-8407-a00a9ad59840" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] Deleting offline snapshot a68b0542-6288-4486-8407-a00a9ad59840 of volume 03208b28-3544-44c8-9684-fafb19daec1c {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] snapshot_file for this snap is: volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[245d47b1-71e6-404d-975b-d6a672773704]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:15:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:30 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840 Jun 25 17:15:30 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:31 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8.45dd6277-66ac-476c-9873-7582bce40d72" returned: 0 in 1.194s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:31 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] Lock "cinder-quobyte-45dd6277-66ac-476c-9873-7582bce40d72" released by "_delete_snapshot" :: held 5.345s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:31 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] Lock "cinder-quobyte-afddaca8-4a4c-4cca-8592-28c72c2ee4b8" released by "delete_snapshot" :: held 5.426s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:31 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 1073741824" returned: 0 in 1.472s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:31 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] Created reservations ['c924bf8f-f33a-4be7-9559-111a31dcfdd8', '7da29ad9-a6bd-4490-902f-5b969b0ae6fb', '49cb2c7e-a413-4661-a3c6-af5fa95c515d', 'c58854fb-f5e7-4266-a3d6-b311e8f52967'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:15:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:31 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 Jun 25 17:15:31 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:31 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] Delete snapshot completed successfully. Jun 25 17:15:31 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b6e748ce-47cb-4422-a696-a7358f6a11ec tempest-VolumesExtendTest-1244819833 None] Lock "cinder-45dd6277-66ac-476c-9873-7582bce40d72-delete_snapshot" released by "delete_snapshot" :: held 5.759s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:32 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840" returned: 0 in 1.268s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:32 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03208b28-3544-44c8-9684-fafb19daec1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:15:32 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10a3d62-093f-408f-934e-29f8812ff88b]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:15:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:32 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 Jun 25 17:15:32 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:32 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:32 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] Acquiring lock "cinder-afddaca8-4a4c-4cca-8592-28c72c2ee4b8-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5" returned: 0 in 0.993s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:32 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] <== create_volume: return (2564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:15:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.568s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8c3eab6-22d4-454c-bacb-6b3e39b63b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c589d759-0d87-4f65-8672-67f5bcc442f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:32 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] Lock "cinder-afddaca8-4a4c-4cca-8592-28c72c2ee4b8-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:32 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Volume volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 (596b3594-2fa6-4d27-9dd4-14c6bc466de5): created successfully Jun 25 17:15:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c589d759-0d87-4f65-8672-67f5bcc442f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Flow 'volume_create_manager' (d018a139-7bc5-42fe-b2e4-9f1f9415f80a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:15:32 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-802361fd-c2c0-4a10-98c5-3f12541da629 tempest-TestStampPattern-1774809409 None] Created volume successfully. Jun 25 17:15:32 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] Acquiring lock "cinder-quobyte-afddaca8-4a4c-4cca-8592-28c72c2ee4b8" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:32 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] Lock "cinder-quobyte-afddaca8-4a4c-4cca-8592-28c72c2ee4b8" acquired by "delete_volume" :: waited 0.022s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:32 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f3fb67-1f5a-4f17-8a12-959c4937cb1a]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:15:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:32 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8 Jun 25 17:15:32 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:33 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2" returned: 0 in 1.240s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:33 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03208b28-3544-44c8-9684-fafb19daec1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:15:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:33 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840 Jun 25 17:15:33 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:34 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8" returned: 0 in 1.267s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:34 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8 Jun 25 17:15:34 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:34 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840" returned: 0 in 1.287s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:34 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840 Jun 25 17:15:34 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:35 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-afddaca8-4a4c-4cca-8592-28c72c2ee4b8" returned: 0 in 1.314s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:35 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] Lock "cinder-quobyte-afddaca8-4a4c-4cca-8592-28c72c2ee4b8" released by "delete_volume" :: held 2.664s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:35 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] Created reservations ['14e2294a-8a01-4153-af32-728077aaac14', 'cbc1a293-5084-4db8-a59a-e140d701588b', '859979a0-4273-4b74-ad08-e5ad914f5764', '24517b7a-fe78-4138-aff5-fa10fbbc6142'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:15:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:35 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:15:35 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:35 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:15:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a68b0542-6288-4486-8407-a00a9ad59840" returned: 0 in 1.176s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:35 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:15:35 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:35 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-quobyte-a68b0542-6288-4486-8407-a00a9ad59840" released by "_delete_snapshot" :: held 5.189s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:35 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-quobyte-03208b28-3544-44c8-9684-fafb19daec1c" released by "delete_snapshot" :: held 5.236s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:36 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] Created reservations ['a2b47a40-5de8-4c81-8481-acb08249bbd6', 'abe07324-1c08-4d7b-ac25-62b91296de22', '4030d122-0d92-40b3-b27b-8457ae6559c5', '1dbc3f62-e920-47d2-baaa-e8ff591ea2c0'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:15:36 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] Delete snapshot completed successfully. Jun 25 17:15:36 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a9bbbc1a-a052-452a-8d98-ddfb65ae9801 tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-a68b0542-6288-4486-8407-a00a9ad59840-delete_snapshot" released by "delete_snapshot" :: held 5.646s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:36 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.189s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:37 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:15:37 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] Deleted volume successfully. Jun 25 17:15:37 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c2367f73-8371-4dd6-84bf-91d282f23b5a tempest-VolumesExtendTest-1244819833 None] Lock "cinder-afddaca8-4a4c-4cca-8592-28c72c2ee4b8-delete_volume" released by "delete_volume" :: held 4.378s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9ed26b42-ffbd-4fce-9aec-6bad31014076 tempest-SnapshotsActionsTest-714163679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9ed26b42-ffbd-4fce-9aec-6bad31014076 tempest-SnapshotsActionsTest-714163679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-9ed26b42-ffbd-4fce-9aec-6bad31014076 tempest-SnapshotsActionsTest-714163679 None] Creating offline snapshot e71345c6-9b02-4275-acc3-9b8ffa8c6f0e of volume 03208b28-3544-44c8-9684-fafb19daec1c {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:15:38 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:15:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Flow 'volume_create_manager' (0fc116aa-acaa-4cda-98d6-e662bd40edf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:15:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72fd663-7cc9-4298-ba01-01b7ce5f87e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:38 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f8111b-725e-4c2d-aa7b-66524994a8c9]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:15:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9ed26b42-ffbd-4fce-9aec-6bad31014076 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72fd663-7cc9-4298-ba01-01b7ce5f87e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-180909373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff940dc-2fd0-464d-a0d3-30090f081300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='873d4f3f457a48248d3f0cb0cd5ff157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:15:38Z,use_quota=True,user_id='ac205bc95ca24ae0a7f954c8764c4a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9727f59-1267-48fb-a1e5-9e99318412eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9727f59-1267-48fb-a1e5-9e99318412eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65a3e52-755c-4c2b-a95d-b01512152d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65a3e52-755c-4c2b-a95d-b01512152d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eff940dc-2fd0-464d-a0d3-30090f081300', 'volume_name': 'volume-eff940dc-2fd0-464d-a0d3-30090f081300', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2024bd-0bf7-4831-8769-eb52605279a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:38 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 Jun 25 17:15:38 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2024bd-0bf7-4831-8769-eb52605279a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27cc2ca1-30cc-459a-b538-47c5d22b54d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:38 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Volume eff940dc-2fd0-464d-a0d3-30090f081300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eff940dc-2fd0-464d-a0d3-30090f081300', 'volume_size': 1} Jun 25 17:15:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:39 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9ed26b42-ffbd-4fce-9aec-6bad31014076 tempest-SnapshotsActionsTest-714163679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2" returned: 0 in 1.097s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-9ed26b42-ffbd-4fce-9aec-6bad31014076 tempest-SnapshotsActionsTest-714163679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03208b28-3544-44c8-9684-fafb19daec1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:15:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9ed26b42-ffbd-4fce-9aec-6bad31014076 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:39 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e 1G Jun 25 17:15:39 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:40 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9ed26b42-ffbd-4fce-9aec-6bad31014076 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e 1G" returned: 0 in 1.160s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9ed26b42-ffbd-4fce-9aec-6bad31014076 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:40 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e Jun 25 17:15:40 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:41 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:15:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Flow 'volume_create_manager' (89ae24cf-a020-49ab-ac08-646325d3555e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:15:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ddccbc8-ff79-47e9-8d26-f987d8fd265d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ddccbc8-ff79-47e9-8d26-f987d8fd265d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1762673497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aad8575-008d-4805-a626-7669f0556cb3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8828721a2fae4fee93f9c3371419e7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:15:41Z,use_quota=True,user_id='be3c152e137447f08104c991bb804c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337f3073-90a5-41f2-b826-cb00aebbe3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (337f3073-90a5-41f2-b826-cb00aebbe3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9921aaa1-c011-4327-8849-fbbb8b5b60d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9921aaa1-c011-4327-8849-fbbb8b5b60d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1aad8575-008d-4805-a626-7669f0556cb3', 'volume_name': 'volume-1aad8575-008d-4805-a626-7669f0556cb3', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20a97f8-9513-48a0-a543-67f48d9c6ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20a97f8-9513-48a0-a543-67f48d9c6ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199f5140-3710-4e98-96bc-db213bfe5400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:41 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Volume 1aad8575-008d-4805-a626-7669f0556cb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1aad8575-008d-4805-a626-7669f0556cb3', 'volume_size': 1} Jun 25 17:15:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:41 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9ed26b42-ffbd-4fce-9aec-6bad31014076 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e" returned: 0 in 0.907s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:41 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-9ed26b42-ffbd-4fce-9aec-6bad31014076 tempest-SnapshotsActionsTest-714163679 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e is being set with open permissions: ugo+rw Jun 25 17:15:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9ed26b42-ffbd-4fce-9aec-6bad31014076 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:41 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e Jun 25 17:15:41 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:42 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9ed26b42-ffbd-4fce-9aec-6bad31014076 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e" returned: 0 in 0.828s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9ed26b42-ffbd-4fce-9aec-6bad31014076 tempest-SnapshotsActionsTest-714163679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.176s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.873s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:15:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-180909373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff940dc-2fd0-464d-a0d3-30090f081300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='873d4f3f457a48248d3f0cb0cd5ff157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:15:38Z,use_quota=True,user_id='ac205bc95ca24ae0a7f954c8764c4a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:15:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Creating volume eff940dc-2fd0-464d-a0d3-30090f081300 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:15:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:15:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:15:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:15:42 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:15:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eff940dc-2fd0-464d-a0d3-30090f081300 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:42 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eff940dc-2fd0-464d-a0d3-30090f081300 1073741824 Jun 25 17:15:42 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:42 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-9ed26b42-ffbd-4fce-9aec-6bad31014076 tempest-SnapshotsActionsTest-714163679 None] Create snapshot completed successfully Jun 25 17:15:43 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] Acquiring lock "cinder-e71345c6-9b02-4275-acc3-9b8ffa8c6f0e-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:43 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-e71345c6-9b02-4275-acc3-9b8ffa8c6f0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:43 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] Acquiring lock "cinder-quobyte-03208b28-3544-44c8-9684-fafb19daec1c" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:43 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-quobyte-03208b28-3544-44c8-9684-fafb19daec1c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:43 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] Acquiring lock "cinder-quobyte-e71345c6-9b02-4275-acc3-9b8ffa8c6f0e" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:43 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-quobyte-e71345c6-9b02-4275-acc3-9b8ffa8c6f0e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] Deleting offline snapshot e71345c6-9b02-4275-acc3-9b8ffa8c6f0e of volume 03208b28-3544-44c8-9684-fafb19daec1c {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:15:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] snapshot_file for this snap is: volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:15:43 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8763b79e-9691-4ca0-906f-05ce0ae317cb]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:15:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:43 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eff940dc-2fd0-464d-a0d3-30090f081300 1073741824" returned: 0 in 1.141s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:43 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e Jun 25 17:15:43 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eff940dc-2fd0-464d-a0d3-30090f081300 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:43 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eff940dc-2fd0-464d-a0d3-30090f081300 Jun 25 17:15:43 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:15:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:15:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:15:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:44 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:15:44 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:45 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e" returned: 0 in 1.724s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03208b28-3544-44c8-9684-fafb19daec1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2553b1-fdb8-435b-8aef-3147566b8752]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:45 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eff940dc-2fd0-464d-a0d3-30090f081300" returned: 0 in 1.661s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] <== create_volume: return (2927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.931s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.975s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1762673497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1aad8575-008d-4805-a626-7669f0556cb3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8828721a2fae4fee93f9c3371419e7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:15:41Z,use_quota=True,user_id='be3c152e137447f08104c991bb804c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Creating volume 1aad8575-008d-4805-a626-7669f0556cb3 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:15:45 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1aad8575-008d-4805-a626-7669f0556cb3 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=77,cinder:SELECT=66,cinder:INSERT=32,cinder:DELETE=7 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:15:45 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1aad8575-008d-4805-a626-7669f0556cb3 1073741824 Jun 25 17:15:45 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27cc2ca1-30cc-459a-b538-47c5d22b54d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff940dc-2fd0-464d-a0d3-30090f081300', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773710a6-d1fb-4e9f-8276-94cfcfe9311c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=78,cinder:UPDATE=72,cinder:INSERT=25,cinder:DELETE=7 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:15:45 devstack sudo[105894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 Jun 25 17:15:45 devstack sudo[105894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:45 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Volume volume-eff940dc-2fd0-464d-a0d3-30090f081300 (eff940dc-2fd0-464d-a0d3-30090f081300): created successfully Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773710a6-d1fb-4e9f-8276-94cfcfe9311c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Flow 'volume_create_manager' (0fc116aa-acaa-4cda-98d6-e662bd40edf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:15:45 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-44021b72-b3a9-4764-a2d5-1ee6a6bf1b3f tempest-VolumesTransfersTest-460680557 None] Created volume successfully. Jun 25 17:15:45 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.325s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 28 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:15:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:15:46 devstack sudo[105894]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2" returned: 0 in 1.780s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03208b28-3544-44c8-9684-fafb19daec1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:15:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:46 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e Jun 25 17:15:46 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:46 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1aad8575-008d-4805-a626-7669f0556cb3 1073741824" returned: 0 in 1.756s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1aad8575-008d-4805-a626-7669f0556cb3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:47 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1aad8575-008d-4805-a626-7669f0556cb3 Jun 25 17:15:47 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:47 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-4789b52c-7c7e-47bf-a139-48073baec6fc tempest-VolumesTransfersTest-291157214 None] Transfer volume completed successfully. Jun 25 17:15:48 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e" returned: 0 in 1.406s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:48 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e Jun 25 17:15:48 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:48 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1aad8575-008d-4805-a626-7669f0556cb3" returned: 0 in 1.386s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] <== create_volume: return (3248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:15:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.253s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (199f5140-3710-4e98-96bc-db213bfe5400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1aad8575-008d-4805-a626-7669f0556cb3', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a1d11c-6cec-4229-aefc-8d4ffcbc99ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:48 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Volume volume-1aad8575-008d-4805-a626-7669f0556cb3 (1aad8575-008d-4805-a626-7669f0556cb3): created successfully Jun 25 17:15:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a1d11c-6cec-4229-aefc-8d4ffcbc99ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Flow 'volume_create_manager' (89ae24cf-a020-49ab-ac08-646325d3555e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:15:48 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-1b7a9e31-5b36-448c-ab70-6be5ff61cd25 tempest-VolumesGetTest-1676953946 None] Created volume successfully. Jun 25 17:15:48 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] Acquiring lock "cinder-eff940dc-2fd0-464d-a0d3-30090f081300-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:48 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] Lock "cinder-eff940dc-2fd0-464d-a0d3-30090f081300-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:48 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] Acquiring lock "cinder-quobyte-eff940dc-2fd0-464d-a0d3-30090f081300" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:49 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] Lock "cinder-quobyte-eff940dc-2fd0-464d-a0d3-30090f081300" acquired by "delete_volume" :: waited 0.028s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:49 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[df766af3-a6d1-4f32-8607-524c3dab7f36]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:15:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eff940dc-2fd0-464d-a0d3-30090f081300 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:49 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eff940dc-2fd0-464d-a0d3-30090f081300 Jun 25 17:15:49 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:49 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.e71345c6-9b02-4275-acc3-9b8ffa8c6f0e" returned: 0 in 1.282s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:49 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-quobyte-e71345c6-9b02-4275-acc3-9b8ffa8c6f0e" released by "_delete_snapshot" :: held 6.394s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:49 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-quobyte-03208b28-3544-44c8-9684-fafb19daec1c" released by "delete_snapshot" :: held 6.437s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:49 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] Created reservations ['858629b6-eb1e-4142-945f-d595e9a5de39', '63544683-2b4b-47a9-bd62-181ece656dc7', 'a0f4e184-34b8-4d1a-8378-191a656c4506', 'f83647e5-2008-427d-a11d-4994c975133c'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:15:49 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] Delete snapshot completed successfully. Jun 25 17:15:49 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6242b001-8a79-4083-9cab-a7d933210680 tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-e71345c6-9b02-4275-acc3-9b8ffa8c6f0e-delete_snapshot" released by "delete_snapshot" :: held 6.808s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:50 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eff940dc-2fd0-464d-a0d3-30090f081300" returned: 0 in 1.585s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eff940dc-2fd0-464d-a0d3-30090f081300 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:15:50 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eff940dc-2fd0-464d-a0d3-30090f081300 Jun 25 17:15:50 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Flow 'volume_create_manager' (67366f59-bc9f-40a1-b3c3-9333ba661dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b0a6a1-78cd-4ef3-9309-47f319c3b252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b0a6a1-78cd-4ef3-9309-47f319c3b252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:15:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-215264443',display_name='tempest-VolumesGetTest-Volume-646446040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10412d25-2d41-4b98-a943-fdf89ee28cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828721a2fae4fee93f9c3371419e7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:15:51Z,use_quota=True,user_id='be3c152e137447f08104c991bb804c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed7d2df5-1196-4895-b684-c1fc8716a485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed7d2df5-1196-4895-b684-c1fc8716a485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913b45f8-858b-48c6-a8a1-ee23d2976e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913b45f8-858b-48c6-a8a1-ee23d2976e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10412d25-2d41-4b98-a943-fdf89ee28cbb', 'volume_name': 'volume-10412d25-2d41-4b98-a943-fdf89ee28cbb', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c110e1-fa24-4e8b-8354-8935e133e251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4c110e1-fa24-4e8b-8354-8935e133e251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f0cb8c-1e71-4853-9707-876894462e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:50 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Volume 10412d25-2d41-4b98-a943-fdf89ee28cbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10412d25-2d41-4b98-a943-fdf89ee28cbb', 'volume_size': 1} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:15:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-215264443',display_name='tempest-VolumesGetTest-Volume-646446040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10412d25-2d41-4b98-a943-fdf89ee28cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828721a2fae4fee93f9c3371419e7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:15:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:15:51Z,use_quota=True,user_id='be3c152e137447f08104c991bb804c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Creating volume 10412d25-2d41-4b98-a943-fdf89ee28cbb {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:15:50 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:15:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-10412d25-2d41-4b98-a943-fdf89ee28cbb 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:50 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-10412d25-2d41-4b98-a943-fdf89ee28cbb 1073741824 Jun 25 17:15:50 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-36c680c2-2433-41c4-a0b9-7f9a37509c33 tempest-SnapshotsActionsTest-714163679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:52 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eff940dc-2fd0-464d-a0d3-30090f081300" returned: 0 in 1.473s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] Lock "cinder-quobyte-eff940dc-2fd0-464d-a0d3-30090f081300" released by "delete_volume" :: held 3.136s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:52 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] Created reservations ['982d07a5-0283-471b-a452-9559b21e4e9f', 'fda73a16-0534-4917-ae20-1083f44bd0bf', '3c6df425-3e4d-4919-a95e-a776f1a5c59f', '6b0ffb98-12f9-4698-af90-0ea4f04a563e'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:15:52 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-10412d25-2d41-4b98-a943-fdf89ee28cbb 1073741824" returned: 0 in 1.572s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-10412d25-2d41-4b98-a943-fdf89ee28cbb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:15:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:15:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:52 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-10412d25-2d41-4b98-a943-fdf89ee28cbb Jun 25 17:15:52 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:52 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:15:52 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:53 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.162s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:53 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:15:53 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] Deleted volume successfully. Jun 25 17:15:53 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5ff03776-b5fe-4be1-bf34-039a17e5e6ba tempest-VolumesTransfersTest-1980327638 None] Lock "cinder-eff940dc-2fd0-464d-a0d3-30090f081300-delete_volume" released by "delete_volume" :: held 4.830s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:53 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-10412d25-2d41-4b98-a943-fdf89ee28cbb" returned: 0 in 1.321s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:53 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] <== create_volume: return (2985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:15:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.988s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-36c680c2-2433-41c4-a0b9-7f9a37509c33 tempest-SnapshotsActionsTest-714163679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.239s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f0cb8c-1e71-4853-9707-876894462e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10412d25-2d41-4b98-a943-fdf89ee28cbb', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e6123c1-1c40-4615-b212-b71e7cfd1317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:53 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-36c680c2-2433-41c4-a0b9-7f9a37509c33 tempest-SnapshotsActionsTest-714163679 None] Creating offline snapshot 22eccf2c-11e7-4874-bcb4-99473454c2cd of volume 03208b28-3544-44c8-9684-fafb19daec1c {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:15:53 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Volume volume-10412d25-2d41-4b98-a943-fdf89ee28cbb (10412d25-2d41-4b98-a943-fdf89ee28cbb): created successfully Jun 25 17:15:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e6123c1-1c40-4615-b212-b71e7cfd1317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Flow 'volume_create_manager' (67366f59-bc9f-40a1-b3c3-9333ba661dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:15:53 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbe4a09-69b2-49f4-843e-a2f373841f74]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:15:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-36c680c2-2433-41c4-a0b9-7f9a37509c33 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:54 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-fb398e35-00ce-4f1a-bb7d-3432b89aa6da tempest-VolumesGetTest-1676953946 None] Created volume successfully. Jun 25 17:15:54 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 Jun 25 17:15:54 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:54 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:15:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Flow 'volume_create_manager' (26729b86-f9ee-4fcd-a2eb-3872fde32479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:15:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0800dbae-bb43-41fb-8de1-cc84987a8de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0800dbae-bb43-41fb-8de1-cc84987a8de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1517596894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae96d91-a4f4-4d9b-9799-06669ae71544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='873d4f3f457a48248d3f0cb0cd5ff157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:15:55Z,use_quota=True,user_id='ac205bc95ca24ae0a7f954c8764c4a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c42b3c-64bb-4d51-bb78-c4bc16f12233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c42b3c-64bb-4d51-bb78-c4bc16f12233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcc51cf-f487-49f3-9ddd-127303ab89d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcc51cf-f487-49f3-9ddd-127303ab89d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ae96d91-a4f4-4d9b-9799-06669ae71544', 'volume_name': 'volume-9ae96d91-a4f4-4d9b-9799-06669ae71544', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da0ba8a-b54b-43d3-ad79-8cab2bbf7c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8da0ba8a-b54b-43d3-ad79-8cab2bbf7c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:15:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e8da294-4b71-4fab-904f-52c4b7b985a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:15:54 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Volume 9ae96d91-a4f4-4d9b-9799-06669ae71544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ae96d91-a4f4-4d9b-9799-06669ae71544', 'volume_size': 1} Jun 25 17:15:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:55 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-36c680c2-2433-41c4-a0b9-7f9a37509c33 tempest-SnapshotsActionsTest-714163679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2" returned: 0 in 1.363s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-36c680c2-2433-41c4-a0b9-7f9a37509c33 tempest-SnapshotsActionsTest-714163679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03208b28-3544-44c8-9684-fafb19daec1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:15:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-36c680c2-2433-41c4-a0b9-7f9a37509c33 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:55 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] Acquiring lock "cinder-10412d25-2d41-4b98-a943-fdf89ee28cbb-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:55 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd 1G Jun 25 17:15:55 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:55 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] Lock "cinder-10412d25-2d41-4b98-a943-fdf89ee28cbb-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:55 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] Acquiring lock "cinder-quobyte-10412d25-2d41-4b98-a943-fdf89ee28cbb" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:55 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] Lock "cinder-quobyte-10412d25-2d41-4b98-a943-fdf89ee28cbb" acquired by "delete_volume" :: waited 0.022s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:55 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08179e4-aef7-4d3c-9d0c-8ed92b9c0f85]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:15:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-10412d25-2d41-4b98-a943-fdf89ee28cbb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:55 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-10412d25-2d41-4b98-a943-fdf89ee28cbb Jun 25 17:15:55 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:56 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-10412d25-2d41-4b98-a943-fdf89ee28cbb" returned: 0 in 0.978s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:56 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-10412d25-2d41-4b98-a943-fdf89ee28cbb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-36c680c2-2433-41c4-a0b9-7f9a37509c33 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd 1G" returned: 0 in 1.247s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-36c680c2-2433-41c4-a0b9-7f9a37509c33 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:56 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-10412d25-2d41-4b98-a943-fdf89ee28cbb Jun 25 17:15:56 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:56 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd Jun 25 17:15:56 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:57 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-10412d25-2d41-4b98-a943-fdf89ee28cbb" returned: 0 in 0.799s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] Lock "cinder-quobyte-10412d25-2d41-4b98-a943-fdf89ee28cbb" released by "delete_volume" :: held 1.845s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:57 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:57 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] Created reservations ['32952389-b5fe-4760-95c3-8223228fc778', 'fdb2fb69-792d-4df6-8a75-d175b0b772e5', 'b36b46e0-52a5-46f9-8c7a-6549fc15a004', 'b082fec1-bbf2-400c-a7e6-b12077a2ca43'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:15:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-36c680c2-2433-41c4-a0b9-7f9a37509c33 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd" returned: 0 in 0.864s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:57 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-36c680c2-2433-41c4-a0b9-7f9a37509c33 tempest-SnapshotsActionsTest-714163679 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd is being set with open permissions: ugo+rw Jun 25 17:15:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-36c680c2-2433-41c4-a0b9-7f9a37509c33 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:57 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd Jun 25 17:15:57 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:57 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:15:57 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:15:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:57 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:15:57 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] Acquiring lock "cinder-1aad8575-008d-4805-a626-7669f0556cb3-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] Lock "cinder-1aad8575-008d-4805-a626-7669f0556cb3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] Acquiring lock "cinder-quobyte-1aad8575-008d-4805-a626-7669f0556cb3" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] Lock "cinder-quobyte-1aad8575-008d-4805-a626-7669f0556cb3" acquired by "delete_volume" :: waited 0.025s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:58 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e4a562-50bb-4327-845a-e882725b3d90]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:15:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1aad8575-008d-4805-a626-7669f0556cb3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:58 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1aad8575-008d-4805-a626-7669f0556cb3 Jun 25 17:15:58 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:58 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-36c680c2-2433-41c4-a0b9-7f9a37509c33 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd" returned: 0 in 1.145s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-36c680c2-2433-41c4-a0b9-7f9a37509c33 tempest-SnapshotsActionsTest-714163679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.879s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.853s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:58 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1517596894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae96d91-a4f4-4d9b-9799-06669ae71544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='873d4f3f457a48248d3f0cb0cd5ff157',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:15:55Z,use_quota=True,user_id='ac205bc95ca24ae0a7f954c8764c4a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:15:58 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Creating volume 9ae96d91-a4f4-4d9b-9799-06669ae71544 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:15:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:15:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:15:58 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:15:58 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:15:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:15:58 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:15:58 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:15:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9ae96d91-a4f4-4d9b-9799-06669ae71544 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:58 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.107s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:58 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:15:58 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9ae96d91-a4f4-4d9b-9799-06669ae71544 1073741824 Jun 25 17:15:58 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:58 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] Deleted volume successfully. Jun 25 17:15:58 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-36c680c2-2433-41c4-a0b9-7f9a37509c33 tempest-SnapshotsActionsTest-714163679 None] Create snapshot completed successfully Jun 25 17:15:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6b7c6bee-cb5f-44e5-9d2b-2917d6510e7c tempest-VolumesGetTest-1676953946 None] Lock "cinder-10412d25-2d41-4b98-a943-fdf89ee28cbb-delete_volume" released by "delete_volume" :: held 3.378s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:15:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] Acquiring lock "cinder-22eccf2c-11e7-4874-bcb4-99473454c2cd-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-22eccf2c-11e7-4874-bcb4-99473454c2cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] Acquiring lock "cinder-quobyte-03208b28-3544-44c8-9684-fafb19daec1c" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-quobyte-03208b28-3544-44c8-9684-fafb19daec1c" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] Acquiring lock "cinder-quobyte-22eccf2c-11e7-4874-bcb4-99473454c2cd" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:15:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-quobyte-22eccf2c-11e7-4874-bcb4-99473454c2cd" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:15:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] Deleting offline snapshot 22eccf2c-11e7-4874-bcb4-99473454c2cd of volume 03208b28-3544-44c8-9684-fafb19daec1c {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:15:59 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] snapshot_file for this snap is: volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:15:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1aad8575-008d-4805-a626-7669f0556cb3" returned: 0 in 1.248s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1aad8575-008d-4805-a626-7669f0556cb3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:59 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52d1fc0-f503-489c-872a-9d6665f37065]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:15:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:59 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1aad8575-008d-4805-a626-7669f0556cb3 Jun 25 17:15:59 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:59 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd Jun 25 17:15:59 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:15:59 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jun 25 17:15:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9ae96d91-a4f4-4d9b-9799-06669ae71544 1073741824" returned: 0 in 1.137s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:15:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9ae96d91-a4f4-4d9b-9799-06669ae71544 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:15:59 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9ae96d91-a4f4-4d9b-9799-06669ae71544 Jun 25 17:15:59 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:00 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1aad8575-008d-4805-a626-7669f0556cb3" returned: 0 in 0.833s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] Lock "cinder-quobyte-1aad8575-008d-4805-a626-7669f0556cb3" released by "delete_volume" :: held 2.160s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] Created reservations ['6ec49804-4c7a-4cf1-be81-665e5d0518f6', '7cef1fdd-153d-472b-abf4-9864f5fa6bcf', 'a4e5e354-3de1-424b-81ae-0f8d8cdb3697', '70daa19c-f01b-477b-9a5e-0ef1f03488fa'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:16:00 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd" returned: 0 in 1.056s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03208b28-3544-44c8-9684-fafb19daec1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:16:00 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:16:00 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[12337d2a-060c-4ba1-985b-1e0023957243]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:00 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 Jun 25 17:16:00 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:00 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9ae96d91-a4f4-4d9b-9799-06669ae71544" returned: 0 in 0.731s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e8da294-4b71-4fab-904f-52c4b7b985a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ae96d91-a4f4-4d9b-9799-06669ae71544', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b009f1-3872-40a4-a5b1-a8abab71bfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:00 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Volume volume-9ae96d91-a4f4-4d9b-9799-06669ae71544 (9ae96d91-a4f4-4d9b-9799-06669ae71544): created successfully Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81b009f1-3872-40a4-a5b1-a8abab71bfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Flow 'volume_create_manager' (26729b86-f9ee-4fcd-a2eb-3872fde32479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:16:00 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-69758e3d-cbf8-411f-a464-1af187797342 tempest-VolumesTransfersTest-460680557 None] Created volume successfully. Jun 25 17:16:01 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.820s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:01 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:16:01 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] Deleted volume successfully. Jun 25 17:16:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5b3d042f-fc97-4b3d-9d3d-ac300ce3a87f tempest-VolumesGetTest-1676953946 None] Lock "cinder-1aad8575-008d-4805-a626-7669f0556cb3-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:01 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2" returned: 0 in 0.973s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03208b28-3544-44c8-9684-fafb19daec1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:16:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] Acquiring lock "cinder-9ae96d91-a4f4-4d9b-9799-06669ae71544-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:01 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd Jun 25 17:16:01 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] Lock "cinder-9ae96d91-a4f4-4d9b-9799-06669ae71544-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] Acquiring lock "cinder-quobyte-9ae96d91-a4f4-4d9b-9799-06669ae71544" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] Lock "cinder-quobyte-9ae96d91-a4f4-4d9b-9799-06669ae71544" acquired by "delete_volume" :: waited 0.026s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:01 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0638df71-43c3-460c-ae5f-5cce5c69d40f]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9ae96d91-a4f4-4d9b-9799-06669ae71544 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:01 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9ae96d91-a4f4-4d9b-9799-06669ae71544 Jun 25 17:16:01 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:01 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:16:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Flow 'volume_create_manager' (c9e8bc0d-891d-415a-8624-b43a6c30161b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:16:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb5fbab-f50e-458a-9d90-a610231082d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb5fbab-f50e-458a-9d90-a610231082d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-922239288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376ef3ed-2118-4d88-96ab-a02a344c7eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828721a2fae4fee93f9c3371419e7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:16:02Z,use_quota=True,user_id='be3c152e137447f08104c991bb804c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2226890-960b-4236-b268-d9b004832703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2226890-960b-4236-b268-d9b004832703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907d6c24-31a9-426c-919a-7c8837c97bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907d6c24-31a9-426c-919a-7c8837c97bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376ef3ed-2118-4d88-96ab-a02a344c7eee', 'volume_name': 'volume-376ef3ed-2118-4d88-96ab-a02a344c7eee', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86ccb0a-165d-450a-931e-ffaa83d274ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86ccb0a-165d-450a-931e-ffaa83d274ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1637b70-05c3-4e55-bcef-0c5cf74258c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:02 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Volume 376ef3ed-2118-4d88-96ab-a02a344c7eee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376ef3ed-2118-4d88-96ab-a02a344c7eee', 'volume_size': 1} Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-922239288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376ef3ed-2118-4d88-96ab-a02a344c7eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828721a2fae4fee93f9c3371419e7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:16:02Z,use_quota=True,user_id='be3c152e137447f08104c991bb804c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Creating volume 376ef3ed-2118-4d88-96ab-a02a344c7eee {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:16:02 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:02 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee 1073741824 Jun 25 17:16:02 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:02 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd" returned: 0 in 1.047s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:02 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd Jun 25 17:16:02 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:02 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9ae96d91-a4f4-4d9b-9799-06669ae71544" returned: 0 in 1.052s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9ae96d91-a4f4-4d9b-9799-06669ae71544 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:02 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9ae96d91-a4f4-4d9b-9799-06669ae71544 Jun 25 17:16:02 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:03 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee 1073741824" returned: 0 in 1.020s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:03 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee Jun 25 17:16:03 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:03 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.22eccf2c-11e7-4874-bcb4-99473454c2cd" returned: 0 in 0.878s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-quobyte-22eccf2c-11e7-4874-bcb4-99473454c2cd" released by "_delete_snapshot" :: held 4.083s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-quobyte-03208b28-3544-44c8-9684-fafb19daec1c" released by "delete_snapshot" :: held 4.122s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:03 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9ae96d91-a4f4-4d9b-9799-06669ae71544" returned: 0 in 0.887s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] Lock "cinder-quobyte-9ae96d91-a4f4-4d9b-9799-06669ae71544" released by "delete_volume" :: held 1.995s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:03 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] Created reservations ['103ff6c8-4b31-4628-b250-dd0bc9551155', 'b3f66eba-9841-4860-876a-b88b0206217f', '5a8ee148-4023-46a4-9d78-b5b29b132b8d', 'babe3f97-8472-4a81-8fe3-172332a6e5e8'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:16:03 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] Delete snapshot completed successfully. Jun 25 17:16:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-331db14d-6d3b-4222-925c-634e67623e03 tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-22eccf2c-11e7-4874-bcb4-99473454c2cd-delete_snapshot" released by "delete_snapshot" :: held 4.439s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:03 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] Created reservations ['fc1c9ebd-20f1-4110-ad36-897551baf886', 'e35c7bae-0aad-4dd4-9341-e3d66b142b6f', 'ae095c74-e611-42aa-af45-0c44b0b70acb', '17a9b8a9-f7c8-40f6-bed5-e946fd4d1f17'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:16:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:03 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:16:03 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:16:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:03 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:16:03 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:04 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee" returned: 0 in 0.974s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:16:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1637b70-05c3-4e55-bcef-0c5cf74258c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376ef3ed-2118-4d88-96ab-a02a344c7eee', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1334e3-88d9-4267-8c04-043941f977fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:04 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Volume volume-376ef3ed-2118-4d88-96ab-a02a344c7eee (376ef3ed-2118-4d88-96ab-a02a344c7eee): created successfully Jun 25 17:16:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e1334e3-88d9-4267-8c04-043941f977fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Flow 'volume_create_manager' (c9e8bc0d-891d-415a-8624-b43a6c30161b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:16:04 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-952313e3-f8fb-4de2-9e14-6896556cb1ef tempest-VolumesGetTest-1676953946 None] Created volume successfully. Jun 25 17:16:04 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.810s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:04 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:16:04 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] Deleted volume successfully. Jun 25 17:16:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9382d590-6a10-42d4-aeb8-ffbd62ca8ec5 tempest-VolumesTransfersTest-1980327638 None] Lock "cinder-9ae96d91-a4f4-4d9b-9799-06669ae71544-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1a392e17-9455-4a92-a4dd-16e67eac9792 tempest-SnapshotsActionsTest-714163679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1a392e17-9455-4a92-a4dd-16e67eac9792 tempest-SnapshotsActionsTest-714163679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-1a392e17-9455-4a92-a4dd-16e67eac9792 tempest-SnapshotsActionsTest-714163679 None] Creating offline snapshot a13a5c1b-7ba6-474e-b2b1-5d185cd6e804 of volume 03208b28-3544-44c8-9684-fafb19daec1c {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:16:05 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6010064-9ba7-4e89-ae57-352c9f987463]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1a392e17-9455-4a92-a4dd-16e67eac9792 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:05 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 Jun 25 17:16:05 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:05 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:16:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Flow 'volume_create_manager' (3823aee8-2e74-46c1-81e0-1cc4cd835fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:16:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a78916-707f-45d0-b3e4-08cbefeeb001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a78916-707f-45d0-b3e4-08cbefeeb001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1617309605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d867db3-5b96-49ce-8f60-c212c4056aa5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8828721a2fae4fee93f9c3371419e7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=376ef3ed-2118-4d88-96ab-a02a344c7eee,status='creating',terminated_at=None,updated_at=2026-06-25T15:16:06Z,use_quota=True,user_id='be3c152e137447f08104c991bb804c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e1bc97-5608-4d93-bc70-ecb13ddde151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e1bc97-5608-4d93-bc70-ecb13ddde151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e978b4b-af85-4f92-a25d-52d86fa48c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e978b4b-af85-4f92-a25d-52d86fa48c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6d867db3-5b96-49ce-8f60-c212c4056aa5', 'volume_name': 'volume-6d867db3-5b96-49ce-8f60-c212c4056aa5', 'volume_size': 1, 'source_volid': '376ef3ed-2118-4d88-96ab-a02a344c7eee', 'source_volstatus': 'available'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a33b37-5873-46d5-bbc7-af67fe966968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a33b37-5873-46d5-bbc7-af67fe966968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f6ea44-43a7-4d59-a32b-342dcfe35ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:06 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Volume 6d867db3-5b96-49ce-8f60-c212c4056aa5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6d867db3-5b96-49ce-8f60-c212c4056aa5', 'volume_size': 1, 'source_volid': '376ef3ed-2118-4d88-96ab-a02a344c7eee', 'source_volstatus': 'available'} Jun 25 17:16:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:06 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1a392e17-9455-4a92-a4dd-16e67eac9792 tempest-SnapshotsActionsTest-714163679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2" returned: 0 in 1.167s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-1a392e17-9455-4a92-a4dd-16e67eac9792 tempest-SnapshotsActionsTest-714163679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03208b28-3544-44c8-9684-fafb19daec1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:16:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1a392e17-9455-4a92-a4dd-16e67eac9792 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:06 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804 1G Jun 25 17:16:06 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:07 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1a392e17-9455-4a92-a4dd-16e67eac9792 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804 1G" returned: 0 in 1.218s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1a392e17-9455-4a92-a4dd-16e67eac9792 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:07 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804 Jun 25 17:16:07 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:08 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1a392e17-9455-4a92-a4dd-16e67eac9792 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804" returned: 0 in 0.914s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:08 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-1a392e17-9455-4a92-a4dd-16e67eac9792 tempest-SnapshotsActionsTest-714163679 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804 is being set with open permissions: ugo+rw Jun 25 17:16:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1a392e17-9455-4a92-a4dd-16e67eac9792 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:08 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804 Jun 25 17:16:08 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:09 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1a392e17-9455-4a92-a4dd-16e67eac9792 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804" returned: 0 in 0.724s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1a392e17-9455-4a92-a4dd-16e67eac9792 tempest-SnapshotsActionsTest-714163679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.204s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.176s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:09 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Cloning volume 376ef3ed-2118-4d88-96ab-a02a344c7eee to volume 6d867db3-5b96-49ce-8f60-c212c4056aa5 Jun 25 17:16:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Creating offline snapshot 1e533fbe-44d1-41a4-ab5c-74a3e43605aa of volume 376ef3ed-2118-4d88-96ab-a02a344c7eee {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:16:09 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-1a392e17-9455-4a92-a4dd-16e67eac9792 tempest-SnapshotsActionsTest-714163679 None] Create snapshot completed successfully Jun 25 17:16:09 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d5bd6e-9cf2-448b-881a-fa98deccbb66]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:09 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee Jun 25 17:16:09 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:10 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee" returned: 0 in 0.879s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:10 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa 1G Jun 25 17:16:10 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] Acquiring lock "cinder-a13a5c1b-7ba6-474e-b2b1-5d185cd6e804-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-a13a5c1b-7ba6-474e-b2b1-5d185cd6e804-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] Acquiring lock "cinder-quobyte-03208b28-3544-44c8-9684-fafb19daec1c" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-quobyte-03208b28-3544-44c8-9684-fafb19daec1c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] Acquiring lock "cinder-quobyte-a13a5c1b-7ba6-474e-b2b1-5d185cd6e804" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-quobyte-a13a5c1b-7ba6-474e-b2b1-5d185cd6e804" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] Deleting offline snapshot a13a5c1b-7ba6-474e-b2b1-5d185cd6e804 of volume 03208b28-3544-44c8-9684-fafb19daec1c {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:16:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] snapshot_file for this snap is: volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:16:10 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a134457-df23-496d-bea1-52c8f37fdc66]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:10 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804 Jun 25 17:16:10 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:11 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa 1G" returned: 0 in 1.033s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-376ef3ed-2118-4d88-96ab-a02a344c7eee -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:11 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-376ef3ed-2118-4d88-96ab-a02a344c7eee -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa Jun 25 17:16:11 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:11 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804" returned: 0 in 0.995s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:11 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03208b28-3544-44c8-9684-fafb19daec1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:16:11 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6093b7-85f7-42d6-8584-07739421f022]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:11 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 Jun 25 17:16:11 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:12 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-376ef3ed-2118-4d88-96ab-a02a344c7eee -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa" returned: 0 in 0.982s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:12 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa is being set with open permissions: ugo+rw Jun 25 17:16:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:12 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa Jun 25 17:16:12 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:12 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:16:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Flow 'volume_create_manager' (9a6cff78-2c51-41ab-97d1-c9caa1dd3fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:16:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d6fb53-b6cd-4ac4-b5e0-4af0dc66fca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12d6fb53-b6cd-4ac4-b5e0-4af0dc66fca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-966553898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f745695-3810-40f6-a344-567a3bb7b197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='450d809d8cb2490ba2cd41c8868e80a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:16:12Z,use_quota=True,user_id='aba93dd309704f4e863c19b11856a983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2a2475-1ee5-4efa-8deb-d8f31d5b5ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2a2475-1ee5-4efa-8deb-d8f31d5b5ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72b1a02-dfe1-4082-8dee-39b02c5aa0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e72b1a02-dfe1-4082-8dee-39b02c5aa0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f745695-3810-40f6-a344-567a3bb7b197', 'volume_name': 'volume-7f745695-3810-40f6-a344-567a3bb7b197', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1183b28-2a5b-4526-8d42-cb75b09d9b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1183b28-2a5b-4526-8d42-cb75b09d9b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a353a5ab-fb5f-414a-968c-8665498a8a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:12 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Volume 7f745695-3810-40f6-a344-567a3bb7b197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f745695-3810-40f6-a344-567a3bb7b197', 'volume_size': 1} Jun 25 17:16:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:12 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2" returned: 0 in 0.960s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03208b28-3544-44c8-9684-fafb19daec1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:16:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:12 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804 Jun 25 17:16:12 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:12 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa" returned: 0 in 0.714s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:12 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.info Jun 25 17:16:12 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:13 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804" returned: 0 in 0.962s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:13 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804 Jun 25 17:16:13 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:13 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.info" returned: 0 in 0.855s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:13 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.info is being set with open permissions: ugo+rw Jun 25 17:16:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:13 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.info Jun 25 17:16:13 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:14 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.a13a5c1b-7ba6-474e-b2b1-5d185cd6e804" returned: 0 in 0.763s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:14 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-quobyte-a13a5c1b-7ba6-474e-b2b1-5d185cd6e804" released by "_delete_snapshot" :: held 3.802s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:14 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-quobyte-03208b28-3544-44c8-9684-fafb19daec1c" released by "delete_snapshot" :: held 3.834s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:14 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] Created reservations ['2d1d6982-c9cc-4407-9780-0de25efe0659', 'f6c50662-3309-4670-a558-92af143c99c8', 'a8ce0e28-4b94-4bfb-8e51-6af90ffd1ec9', '9a59454b-a91f-4c25-879f-ad74f9a1c96a'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:16:14 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] Delete snapshot completed successfully. Jun 25 17:16:14 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-afa2a3f8-1058-4124-8cc6-f79ea0ac8bfa tempest-SnapshotsActionsTest-906132198 None] Lock "cinder-a13a5c1b-7ba6-474e-b2b1-5d185cd6e804-delete_snapshot" released by "delete_snapshot" :: held 4.032s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:14 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.info" returned: 0 in 0.837s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:14 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Acquiring lock "cinder-quobyte-6d867db3-5b96-49ce-8f60-c212c4056aa5" by "_copy_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:14 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Lock "cinder-quobyte-6d867db3-5b96-49ce-8f60-c212c4056aa5" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] snapshot: 1e533fbe-44d1-41a4-ab5c-74a3e43605aa, volume: 6d867db3-5b96-49ce-8f60-c212c4056aa5, {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 17:16:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:16:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:16:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:14 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9e1447-4faa-44e3-9687-7b619be74a97]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:14 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa Jun 25 17:16:14 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:15 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] Acquiring lock "cinder-8f06541d-3e60-4689-bcda-877b80468fe2-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:15 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] Lock "cinder-8f06541d-3e60-4689-bcda-877b80468fe2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:15 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] Acquiring lock "cinder-quobyte-03208b28-3544-44c8-9684-fafb19daec1c" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:15 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] Lock "cinder-quobyte-03208b28-3544-44c8-9684-fafb19daec1c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:15 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] Acquiring lock "cinder-quobyte-8f06541d-3e60-4689-bcda-877b80468fe2" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:15 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] Lock "cinder-quobyte-8f06541d-3e60-4689-bcda-877b80468fe2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] Deleting offline snapshot 8f06541d-3e60-4689-bcda-877b80468fe2 of volume 03208b28-3544-44c8-9684-fafb19daec1c {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:16:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] snapshot_file for this snap is: volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:16:15 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b568d9ee-27ee-4a5c-96ea-6a87a44c549b]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:15 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 Jun 25 17:16:15 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:15 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa" returned: 0 in 0.895s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-376ef3ed-2118-4d88-96ab-a02a344c7eee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:16:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] will copy from snapshot at /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 17:16:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Creating direct copy from snapshot {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 17:16:15 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9298b8f-aad0-4c9a-9c5a-81dcb0028bfe]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:15 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee Jun 25 17:16:15 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:16 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2" returned: 0 in 0.915s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03208b28-3544-44c8-9684-fafb19daec1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:16:16 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b9bef9-51c9-4ad5-b9af-1352b26ddec2]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:16 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c Jun 25 17:16:16 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:16 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee" returned: 0 in 0.865s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:16 devstack cinder-volume[93869]: DEBUG cinder.utils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Path /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6d867db3-5b96-49ce-8f60-c212c4056aa5 not found in is_blk_device check {{(pid=93869) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 17:16:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6d867db3-5b96-49ce-8f60-c212c4056aa5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:16 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6d867db3-5b96-49ce-8f60-c212c4056aa5 Jun 25 17:16:16 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-50ea415f-8c4e-49fe-89e5-556c40f0e3b6 req-b5adae01-1cb5-4271-b581-b9a5913b45b8 tempest-TestStampPattern-1774809409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:17 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c" returned: 0 in 0.866s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:17 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 Jun 25 17:16:17 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:19 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2" returned: 0 in 2.095s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:19 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2 Jun 25 17:16:19 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:20 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c.8f06541d-3e60-4689-bcda-877b80468fe2" returned: 0 in 1.375s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] Lock "cinder-quobyte-8f06541d-3e60-4689-bcda-877b80468fe2" released by "_delete_snapshot" :: held 5.444s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] Lock "cinder-quobyte-03208b28-3544-44c8-9684-fafb19daec1c" released by "delete_snapshot" :: held 5.489s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:20 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] Created reservations ['b892f0bd-fcf3-4ffd-b75e-277c51f029ac', '4d0d93ee-0396-4eff-ba44-5b50e46b9f88', '7b5654d1-91e3-4048-8a28-b1de228a1135', 'b2aa3673-1147-4995-86bb-1bd0ab81e481'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:16:21 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] Delete snapshot completed successfully. Jun 25 17:16:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5623edce-b9a3-4f2e-9ad8-bdbda493da20 tempest-SnapshotsActionsTest-714163679 None] Lock "cinder-8f06541d-3e60-4689-bcda-877b80468fe2-delete_snapshot" released by "delete_snapshot" :: held 5.882s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:22 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] Acquiring lock "cinder-03208b28-3544-44c8-9684-fafb19daec1c-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:22 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] Lock "cinder-03208b28-3544-44c8-9684-fafb19daec1c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:22 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] Acquiring lock "cinder-quobyte-03208b28-3544-44c8-9684-fafb19daec1c" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:22 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] Lock "cinder-quobyte-03208b28-3544-44c8-9684-fafb19daec1c" acquired by "delete_volume" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:22 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[073810b9-7892-452d-8030-fd7af902c5ef]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:22 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6d867db3-5b96-49ce-8f60-c212c4056aa5" returned: 0 in 5.849s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:22 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aba7c63-113d-41d4-adda-f3977f88347b]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:22 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c Jun 25 17:16:22 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:22 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee Jun 25 17:16:22 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:23 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c" returned: 0 in 0.889s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:23 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c Jun 25 17:16:23 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:23 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee" returned: 0 in 1.088s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:23 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Image conversion details: src /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6d867db3-5b96-49ce-8f60-c212c4056aa5 {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:16:23 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Converted 1024.00 MB image at 175.01 MB/s Jun 25 17:16:23 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6d867db3-5b96-49ce-8f60-c212c4056aa5 is being set with open permissions: ugo+rw Jun 25 17:16:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6d867db3-5b96-49ce-8f60-c212c4056aa5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:23 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6d867db3-5b96-49ce-8f60-c212c4056aa5 Jun 25 17:16:23 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:23 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-03208b28-3544-44c8-9684-fafb19daec1c" returned: 0 in 0.749s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] Lock "cinder-quobyte-03208b28-3544-44c8-9684-fafb19daec1c" released by "delete_volume" :: held 1.731s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:24 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] Created reservations ['69d76d9c-5795-41e1-a7f0-d69b42826977', '97ee8e58-ae1d-4b2c-81cb-0b030483ade4', 'ed41d96c-c592-49b4-9a83-25eb9537ea72', '1209eeb3-1870-404c-ad11-db09b3755df7'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:16:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:16:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:16:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:24 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:16:24 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:24 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6d867db3-5b96-49ce-8f60-c212c4056aa5" returned: 0 in 0.823s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Lock "cinder-quobyte-6d867db3-5b96-49ce-8f60-c212c4056aa5" released by "_copy_volume_from_snapshot" :: held 9.639s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Acquiring lock "cinder-quobyte-1e533fbe-44d1-41a4-ab5c-74a3e43605aa" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Lock "cinder-quobyte-1e533fbe-44d1-41a4-ab5c-74a3e43605aa" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Deleting offline snapshot 1e533fbe-44d1-41a4-ab5c-74a3e43605aa of volume 376ef3ed-2118-4d88-96ab-a02a344c7eee {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:16:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] snapshot_file for this snap is: volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:16:24 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da51ad4-3107-48b4-8629-f377ff9bff91]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:24 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa Jun 25 17:16:24 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:25 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.891s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:25 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:16:25 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] Deleted volume successfully. Jun 25 17:16:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-43338af4-8ff1-4539-8430-1e480082b2b1 tempest-SnapshotsActionsTest-714163679 None] Lock "cinder-03208b28-3544-44c8-9684-fafb19daec1c-delete_volume" released by "delete_volume" :: held 2.919s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:25 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa" returned: 0 in 1.029s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-376ef3ed-2118-4d88-96ab-a02a344c7eee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:16:25 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea38a0b8-6560-470a-a88e-7e5b5c4f92e0]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:25 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee Jun 25 17:16:25 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:26 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee" returned: 0 in 0.998s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:26 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa Jun 25 17:16:26 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:27 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa" returned: 0 in 1.068s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:27 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa Jun 25 17:16:27 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:28 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee.1e533fbe-44d1-41a4-ab5c-74a3e43605aa" returned: 0 in 0.773s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:28 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Lock "cinder-quobyte-1e533fbe-44d1-41a4-ab5c-74a3e43605aa" released by "_delete_snapshot" :: held 3.993s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.193s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.044s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-966553898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f745695-3810-40f6-a344-567a3bb7b197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='450d809d8cb2490ba2cd41c8868e80a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:16:12Z,use_quota=True,user_id='aba93dd309704f4e863c19b11856a983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:16:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Creating volume 7f745695-3810-40f6-a344-567a3bb7b197 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:16:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:16:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:16:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:16:28 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:16:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f6ea44-43a7-4d59-a32b-342dcfe35ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d867db3-5b96-49ce-8f60-c212c4056aa5', 'volume_size': 1, 'source_volid': '376ef3ed-2118-4d88-96ab-a02a344c7eee', 'source_volstatus': 'available'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:28 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 1073741824 Jun 25 17:16:28 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a95488-76de-4ac2-a44e-dff38be1a5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:28 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Volume volume-6d867db3-5b96-49ce-8f60-c212c4056aa5 (6d867db3-5b96-49ce-8f60-c212c4056aa5): created successfully Jun 25 17:16:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a95488-76de-4ac2-a44e-dff38be1a5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Flow 'volume_create_manager' (3823aee8-2e74-46c1-81e0-1cc4cd835fca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:16:28 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-d786ab3b-4bd5-4925-a6e3-f0a2bfa39c30 tempest-VolumesGetTest-1676953946 None] Created volume successfully. Jun 25 17:16:29 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 1073741824" returned: 0 in 1.062s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:29 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 Jun 25 17:16:29 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Flow 'volume_create_manager' (12af4276-b5ca-446b-98e3-af837bd61183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af81245-f3c7-44ab-96fe-9219ebd377f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af81245-f3c7-44ab-96fe-9219ebd377f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:16:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-340815880',display_name='tempest-VolumesGetTest-Volume-1130192862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d2777c-0ed4-4074-a484-dcad4ffc0538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828721a2fae4fee93f9c3371419e7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:16:30Z,use_quota=True,user_id='be3c152e137447f08104c991bb804c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2ca99e-0eb0-4844-8058-4413cdc2c73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2ca99e-0eb0-4844-8058-4413cdc2c73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb08d1e8-5c25-4774-b9d7-f4c9ddb7f26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb08d1e8-5c25-4774-b9d7-f4c9ddb7f26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25d2777c-0ed4-4074-a484-dcad4ffc0538', 'volume_name': 'volume-25d2777c-0ed4-4074-a484-dcad4ffc0538', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84139145-9f0e-4866-8672-b46b9022e257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84139145-9f0e-4866-8672-b46b9022e257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47c6899-5a30-44fe-93ce-e7cd9299887b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:30 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Volume 25d2777c-0ed4-4074-a484-dcad4ffc0538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25d2777c-0ed4-4074-a484-dcad4ffc0538', 'volume_size': 1} Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:30 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197" returned: 0 in 0.812s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.929s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-50ea415f-8c4e-49fe-89e5-556c40f0e3b6 req-b5adae01-1cb5-4271-b581-b9a5913b45b8 tempest-TestStampPattern-1774809409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.216s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a353a5ab-fb5f-414a-968c-8665498a8a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f745695-3810-40f6-a344-567a3bb7b197', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4029e96e-0e46-4a80-9a17-e53b02613a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b84e67a-e60d-4a03-8629-4f4c6ffb5098]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-50ea415f-8c4e-49fe-89e5-556c40f0e3b6 req-b5adae01-1cb5-4271-b581-b9a5913b45b8 tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:30 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Volume volume-7f745695-3810-40f6-a344-567a3bb7b197 (7f745695-3810-40f6-a344-567a3bb7b197): created successfully Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4029e96e-0e46-4a80-9a17-e53b02613a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Flow 'volume_create_manager' (9a6cff78-2c51-41ab-97d1-c9caa1dd3fff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:16:30 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-e69b6a9a-58a5-4028-8982-c7cbf1ebef6d tempest-VolumesCloneTest-1021139331 None] Created volume successfully. Jun 25 17:16:30 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 Jun 25 17:16:30 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:31 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-50ea415f-8c4e-49fe-89e5-556c40f0e3b6 req-b5adae01-1cb5-4271-b581-b9a5913b45b8 tempest-TestStampPattern-1774809409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5" returned: 0 in 0.830s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-50ea415f-8c4e-49fe-89e5-556c40f0e3b6 req-b5adae01-1cb5-4271-b581-b9a5913b45b8 tempest-TestStampPattern-1774809409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.858s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.951s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:16:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-340815880',display_name='tempest-VolumesGetTest-Volume-1130192862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25d2777c-0ed4-4074-a484-dcad4ffc0538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828721a2fae4fee93f9c3371419e7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:16:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:16:30Z,use_quota=True,user_id='be3c152e137447f08104c991bb804c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:16:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Creating volume 25d2777c-0ed4-4074-a484-dcad4ffc0538 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:16:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:16:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:16:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:16:31 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:16:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-25d2777c-0ed4-4074-a484-dcad4ffc0538 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:31 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-25d2777c-0ed4-4074-a484-dcad4ffc0538 1073741824 Jun 25 17:16:31 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-50ea415f-8c4e-49fe-89e5-556c40f0e3b6 req-b5adae01-1cb5-4271-b581-b9a5913b45b8 tempest-TestStampPattern-1774809409 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7b82422-0c13-4f55-8f11-28a6bcbd8098', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:16:31 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-50ea415f-8c4e-49fe-89e5-556c40f0e3b6 req-b5adae01-1cb5-4271-b581-b9a5913b45b8 tempest-TestStampPattern-1774809409 None] attachment_update completed successfully. Jun 25 17:16:32 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:16:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Flow 'volume_create_manager' (5ce58083-30ca-4f31-98e5-7a1ee4a8f1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:16:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77cff6ed-132d-4772-b163-f4531f1bc588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77cff6ed-132d-4772-b163-f4531f1bc588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1842613838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90f06417-4304-4aa5-a12c-fcbba9c5e485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='450d809d8cb2490ba2cd41c8868e80a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:16:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=7f745695-3810-40f6-a344-567a3bb7b197,status='creating',terminated_at=None,updated_at=2026-06-25T15:16:32Z,use_quota=True,user_id='aba93dd309704f4e863c19b11856a983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f7b51c-503e-4cc6-b542-3da170db316a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8f7b51c-503e-4cc6-b542-3da170db316a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3e2f34-3479-4a0e-8b6c-07aa17af4428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e3e2f34-3479-4a0e-8b6c-07aa17af4428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '90f06417-4304-4aa5-a12c-fcbba9c5e485', 'volume_name': 'volume-90f06417-4304-4aa5-a12c-fcbba9c5e485', 'volume_size': 2, 'source_volid': '7f745695-3810-40f6-a344-567a3bb7b197', 'source_volstatus': 'available'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4baf4bb2-b2a8-43cc-98d2-df053d45f681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4baf4bb2-b2a8-43cc-98d2-df053d45f681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eada39fd-391e-4b53-9a51-a058775f297b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:32 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Volume 90f06417-4304-4aa5-a12c-fcbba9c5e485: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-90f06417-4304-4aa5-a12c-fcbba9c5e485', 'volume_size': 2, 'source_volid': '7f745695-3810-40f6-a344-567a3bb7b197', 'source_volstatus': 'available'} Jun 25 17:16:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:32 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-25d2777c-0ed4-4074-a484-dcad4ffc0538 1073741824" returned: 0 in 1.293s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-25d2777c-0ed4-4074-a484-dcad4ffc0538 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:32 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-25d2777c-0ed4-4074-a484-dcad4ffc0538 Jun 25 17:16:32 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:33 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-25d2777c-0ed4-4074-a484-dcad4ffc0538" returned: 0 in 0.813s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:33 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:16:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.158s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.999s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:33 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Cloning volume 7f745695-3810-40f6-a344-567a3bb7b197 to volume 90f06417-4304-4aa5-a12c-fcbba9c5e485 Jun 25 17:16:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47c6899-5a30-44fe-93ce-e7cd9299887b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25d2777c-0ed4-4074-a484-dcad4ffc0538', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7d062a-eb6f-454e-84da-63e4fe2529f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:33 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Volume volume-25d2777c-0ed4-4074-a484-dcad4ffc0538 (25d2777c-0ed4-4074-a484-dcad4ffc0538): created successfully Jun 25 17:16:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f7d062a-eb6f-454e-84da-63e4fe2529f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Flow 'volume_create_manager' (12af4276-b5ca-446b-98e3-af837bd61183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:16:33 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Creating offline snapshot 24cc0254-de8d-498e-b039-66da105d3504 of volume 7f745695-3810-40f6-a344-567a3bb7b197 {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:16:33 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b827d13f-a159-4aa0-ba6a-506321dceed4 tempest-VolumesGetTest-1676953946 None] Created volume successfully. Jun 25 17:16:33 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[063f2baa-7e1a-4912-9f4b-d253f007eb21]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:33 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 Jun 25 17:16:33 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:34 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] Acquiring lock "cinder-25d2777c-0ed4-4074-a484-dcad4ffc0538-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:34 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] Lock "cinder-25d2777c-0ed4-4074-a484-dcad4ffc0538-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:34 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] Acquiring lock "cinder-quobyte-25d2777c-0ed4-4074-a484-dcad4ffc0538" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:34 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] Lock "cinder-quobyte-25d2777c-0ed4-4074-a484-dcad4ffc0538" acquired by "delete_volume" :: waited 0.019s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:34 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64f4e83-a5a3-4695-a5d3-9cca9d20389d]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-25d2777c-0ed4-4074-a484-dcad4ffc0538 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:34 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197" returned: 0 in 1.040s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:34 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504 1G Jun 25 17:16:34 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:34 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-25d2777c-0ed4-4074-a484-dcad4ffc0538 Jun 25 17:16:34 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:35 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-25d2777c-0ed4-4074-a484-dcad4ffc0538" returned: 0 in 1.033s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-25d2777c-0ed4-4074-a484-dcad4ffc0538 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:35 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-25d2777c-0ed4-4074-a484-dcad4ffc0538 Jun 25 17:16:35 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:35 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504 1G" returned: 0 in 1.154s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f745695-3810-40f6-a344-567a3bb7b197 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:35 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f745695-3810-40f6-a344-567a3bb7b197 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504 Jun 25 17:16:35 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:36 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-25d2777c-0ed4-4074-a484-dcad4ffc0538" returned: 0 in 0.899s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:36 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] Lock "cinder-quobyte-25d2777c-0ed4-4074-a484-dcad4ffc0538" released by "delete_volume" :: held 1.996s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:36 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] Created reservations ['af638c1e-fc8e-40c2-b1b6-f192e0c6224b', 'b4269439-d2d8-46bf-b931-5647b68108b7', '54a6726c-c47a-49d2-9137-5308abc7c0bf', '7e1d6e26-3c2b-4e0a-ba3c-dcff8e5e78f6'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:16:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:16:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:16:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:36 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:16:36 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:36 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f745695-3810-40f6-a344-567a3bb7b197 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504" returned: 0 in 1.061s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:36 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504 is being set with open permissions: ugo+rw Jun 25 17:16:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:36 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504 Jun 25 17:16:36 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:37 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.980s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:37 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:16:37 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] Deleted volume successfully. Jun 25 17:16:37 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504" returned: 0 in 0.928s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:37 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ce61dba3-d519-45ec-9227-8e9829084821 tempest-VolumesGetTest-1676953946 None] Lock "cinder-25d2777c-0ed4-4074-a484-dcad4ffc0538-delete_volume" released by "delete_volume" :: held 3.366s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:37 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.info Jun 25 17:16:37 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:37 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] Acquiring lock "cinder-6d867db3-5b96-49ce-8f60-c212c4056aa5-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:37 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] Lock "cinder-6d867db3-5b96-49ce-8f60-c212c4056aa5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:37 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] Acquiring lock "cinder-quobyte-6d867db3-5b96-49ce-8f60-c212c4056aa5" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:37 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] Lock "cinder-quobyte-6d867db3-5b96-49ce-8f60-c212c4056aa5" acquired by "delete_volume" :: waited 0.028s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:37 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9431c3a-b226-428e-b0f6-fdba25d261a9]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6d867db3-5b96-49ce-8f60-c212c4056aa5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:38 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6d867db3-5b96-49ce-8f60-c212c4056aa5 Jun 25 17:16:38 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:38 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.info" returned: 0 in 0.843s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:38 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.info is being set with open permissions: ugo+rw Jun 25 17:16:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:38 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.info Jun 25 17:16:38 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:38 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:16:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Flow 'volume_create_manager' (86d9f55a-b675-476b-b09b-eef9fb3c70e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:16:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37c0ce1-df67-4fd9-9ad4-3b4dd85fcee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b37c0ce1-df67-4fd9-9ad4-3b4dd85fcee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-318521330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c02d50fa-b673-4cca-a3e4-f28cec903627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b576fa15b79e49849121e6624f09b50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:16:39Z,use_quota=True,user_id='947f9c2bb9be425484a420a372c0e85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433e500c-b822-475d-985b-e4c7a9417cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433e500c-b822-475d-985b-e4c7a9417cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d7fd88-1063-4916-82b4-09c0fe0d70fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d7fd88-1063-4916-82b4-09c0fe0d70fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c02d50fa-b673-4cca-a3e4-f28cec903627', 'volume_name': 'volume-c02d50fa-b673-4cca-a3e4-f28cec903627', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a10a8b-5d4c-4da0-acb8-bf6967ee4694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a10a8b-5d4c-4da0-acb8-bf6967ee4694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7871d12f-562d-4ba1-ac23-1fc7088fa097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:39 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Volume c02d50fa-b673-4cca-a3e4-f28cec903627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c02d50fa-b673-4cca-a3e4-f28cec903627', 'volume_size': 1} Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:39 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6d867db3-5b96-49ce-8f60-c212c4056aa5" returned: 0 in 1.160s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6d867db3-5b96-49ce-8f60-c212c4056aa5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:39 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6d867db3-5b96-49ce-8f60-c212c4056aa5 Jun 25 17:16:39 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:39 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.info" returned: 0 in 1.014s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Acquiring lock "cinder-quobyte-90f06417-4304-4aa5-a12c-fcbba9c5e485" by "_copy_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Lock "cinder-quobyte-90f06417-4304-4aa5-a12c-fcbba9c5e485" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] snapshot: 24cc0254-de8d-498e-b039-66da105d3504, volume: 90f06417-4304-4aa5-a12c-fcbba9c5e485, {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e76d23-83fa-4081-8b3e-3512be694ef2]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:39 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504 Jun 25 17:16:39 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:40 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6d867db3-5b96-49ce-8f60-c212c4056aa5" returned: 0 in 0.900s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:40 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] Lock "cinder-quobyte-6d867db3-5b96-49ce-8f60-c212c4056aa5" released by "delete_volume" :: held 2.124s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:40 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] Created reservations ['eaf3f3cd-fbff-47d6-93ab-aeebb196c465', 'b7ab08e4-b318-47e9-98f6-67bfcd2763af', 'ec45221b-17d8-4016-ae11-656e2963190d', 'c65b989f-8047-42ea-a15a-ff611af20261'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:16:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:40 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:16:40 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:16:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:40 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:16:40 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:40 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504" returned: 0 in 1.065s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:40 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f745695-3810-40f6-a344-567a3bb7b197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:16:40 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] will copy from snapshot at /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 17:16:40 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Creating direct copy from snapshot {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 17:16:40 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8fc7f1-b5d2-47b7-b4bb-627ef00f7856]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:40 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 Jun 25 17:16:40 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:41 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.974s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:41 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:16:41 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] Deleted volume successfully. Jun 25 17:16:41 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-33a351e4-480f-423b-9fad-0b971ecb344d tempest-VolumesGetTest-1676953946 None] Lock "cinder-6d867db3-5b96-49ce-8f60-c212c4056aa5-delete_volume" released by "delete_volume" :: held 3.467s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:41 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] Acquiring lock "cinder-376ef3ed-2118-4d88-96ab-a02a344c7eee-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:41 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] Lock "cinder-376ef3ed-2118-4d88-96ab-a02a344c7eee-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:41 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] Acquiring lock "cinder-quobyte-376ef3ed-2118-4d88-96ab-a02a344c7eee" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:41 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] Lock "cinder-quobyte-376ef3ed-2118-4d88-96ab-a02a344c7eee" acquired by "delete_volume" :: waited 0.019s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:41 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[160a545b-63af-43fc-992e-78b46fbae73e]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:41 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee Jun 25 17:16:41 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:41 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197" returned: 0 in 0.992s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:41 devstack cinder-volume[93869]: DEBUG cinder.utils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Path /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-90f06417-4304-4aa5-a12c-fcbba9c5e485 not found in is_blk_device check {{(pid=93869) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 17:16:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-90f06417-4304-4aa5-a12c-fcbba9c5e485 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:41 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-90f06417-4304-4aa5-a12c-fcbba9c5e485 Jun 25 17:16:41 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:42 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-29fecf01-335c-4d01-8e9a-5003fcae3fbf req-96323dfa-d574-4bff-9cf3-f631d533d4e2 tempest-TestStampPattern-1774809409 None] Terminate volume connection completed successfully. Jun 25 17:16:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-29fecf01-335c-4d01-8e9a-5003fcae3fbf req-96323dfa-d574-4bff-9cf3-f631d533d4e2 tempest-TestStampPattern-1774809409 None] Deleting attachment a7b82422-0c13-4f55-8f11-28a6bcbd8098. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:16:42 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee" returned: 0 in 1.077s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:42 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee Jun 25 17:16:42 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:44 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-376ef3ed-2118-4d88-96ab-a02a344c7eee" returned: 0 in 1.447s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] Lock "cinder-quobyte-376ef3ed-2118-4d88-96ab-a02a344c7eee" released by "delete_volume" :: held 2.620s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:16:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:16:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:16:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:44 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:16:44 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:44 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] Created reservations ['92fb11ea-5e37-4ad8-88c7-6ded1d706118', 'ca9de9a4-92bd-4357-a292-85edf2e8e729', 'ea9a0143-a97e-44a2-bc2e-044272da540b', '1d8f5f14-cdaf-42ef-91ee-6c015aa87a72'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:16:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:16:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:16:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:44 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:16:44 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:45 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=119,cinder:DELETE=11,cinder:SELECT=88,cinder:INSERT=27 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:16:45 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=110,cinder:SELECT=98,cinder:INSERT=32,cinder:DELETE=6 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:16:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e16beb27-96cb-4f00-93b2-2ce1d3ad823b tempest-TestStampPattern-1774809409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:46 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 2.345s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:46 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:16:46 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:16:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 28 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:16:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:16:46 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 2.202s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:46 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:16:46 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] Deleted volume successfully. Jun 25 17:16:46 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9e19a74f-bec5-473c-97a0-56bf3552bff5 tempest-VolumesGetTest-1676953946 None] Lock "cinder-376ef3ed-2118-4d88-96ab-a02a344c7eee-delete_volume" released by "delete_volume" :: held 5.565s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:47 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:16:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Flow 'volume_create_manager' (ab6b66e3-ee40-4712-a984-af33f8566506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:16:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a843be-6570-43f0-ae13-e3595483810f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a843be-6570-43f0-ae13-e3595483810f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-902362447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5559afc8-436b-441f-bdab-b669536b082f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8828721a2fae4fee93f9c3371419e7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:16:48Z,use_quota=True,user_id='be3c152e137447f08104c991bb804c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff5937d-bb32-47ef-8e96-f66f86caeb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ff5937d-bb32-47ef-8e96-f66f86caeb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0645b77b-fc4e-4036-9559-ed5f7433e32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:47 devstack cinder-volume[93869]: DEBUG cinder.image.glance [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Creating Keystone auth plugin from conf {{(pid=93869) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 17:16:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0645b77b-fc4e-4036-9559-ed5f7433e32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5559afc8-436b-441f-bdab-b669536b082f', 'volume_name': 'volume-5559afc8-436b-441f-bdab-b669536b082f', 'volume_size': 1, 'image_id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5ca37abeabcb4631932d73e3b5ba0213', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'created_at': datetime.datetime(2026, 6, 25, 14, 55, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 14, 55, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee821749-fc82-479d-867e-eb9bd1200c86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241e4051-947e-48fd-a2d4-917c68bfd3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241e4051-947e-48fd-a2d4-917c68bfd3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb00d68-c73f-4deb-8e52-32893e814eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:48 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Volume 5559afc8-436b-441f-bdab-b669536b082f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5559afc8-436b-441f-bdab-b669536b082f', 'volume_size': 1, 'image_id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5ca37abeabcb4631932d73e3b5ba0213', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'created_at': datetime.datetime(2026, 6, 25, 14, 55, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 14, 55, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee821749-fc82-479d-867e-eb9bd1200c86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 17:16:48 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Trying to clone 5559afc8-436b-441f-bdab-b669536b082f from image ee821749-fc82-479d-867e-eb9bd1200c86 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}]). {{(pid=93869) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 17:16:48 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-90f06417-4304-4aa5-a12c-fcbba9c5e485" returned: 0 in 6.845s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:48 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28fa25c-e5f2-4906-84a0-b11d4fc1bc4b]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:48 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 Jun 25 17:16:48 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:48 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_9mv385vddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 17:16:48 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Image download 20.69 MB at 20.69 MB/s Jun 25 17:16:48 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[db434838-c3e4-4ce0-a17c-98510578568e]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_9mv385vddevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:49 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_9mv385vddevstack@QuobyteHD Jun 25 17:16:49 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:49 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197" returned: 0 in 1.013s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:49 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Image conversion details: src /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-90f06417-4304-4aa5-a12c-fcbba9c5e485 {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:16:49 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Converted 1024.00 MB image at 149.59 MB/s Jun 25 17:16:49 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-90f06417-4304-4aa5-a12c-fcbba9c5e485 is being set with open permissions: ugo+rw Jun 25 17:16:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-90f06417-4304-4aa5-a12c-fcbba9c5e485 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:49 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-90f06417-4304-4aa5-a12c-fcbba9c5e485 Jun 25 17:16:49 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:49 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_9mv385vddevstack@QuobyteHD" returned: 0 in 0.897s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:49 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Temporary image ee821749-fc82-479d-867e-eb9bd1200c86 is fetched for user be3c152e137447f08104c991bb804c66. {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 17:16:49 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2464a395-c598-4f84-a89e-b9f113d3e8c5]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_9mv385vddevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:50 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_9mv385vddevstack@QuobyteHD Jun 25 17:16:50 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:50 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-90f06417-4304-4aa5-a12c-fcbba9c5e485" returned: 0 in 0.825s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Lock "cinder-quobyte-90f06417-4304-4aa5-a12c-fcbba9c5e485" released by "_copy_volume_from_snapshot" :: held 10.867s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Acquiring lock "cinder-quobyte-24cc0254-de8d-498e-b039-66da105d3504" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Lock "cinder-quobyte-24cc0254-de8d-498e-b039-66da105d3504" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Deleting offline snapshot 24cc0254-de8d-498e-b039-66da105d3504 of volume 7f745695-3810-40f6-a344-567a3bb7b197 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:16:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] snapshot_file for this snap is: volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:16:50 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2d750d-8fe7-4a26-a7fd-ca8ddd1715f1]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:50 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504 Jun 25 17:16:50 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:50 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_9mv385vddevstack@QuobyteHD" returned: 0 in 0.889s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:51 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504" returned: 0 in 0.929s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:51 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f745695-3810-40f6-a344-567a3bb7b197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:16:51 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c15083a-6c66-4795-a3d7-653a50e37de4]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:51 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 Jun 25 17:16:51 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:52 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197" returned: 0 in 0.893s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:52 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504 Jun 25 17:16:52 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:53 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504" returned: 0 in 0.888s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:53 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504 Jun 25 17:16:53 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:54 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197.24cc0254-de8d-498e-b039-66da105d3504" returned: 0 in 0.750s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Lock "cinder-quobyte-24cc0254-de8d-498e-b039-66da105d3504" released by "_delete_snapshot" :: held 3.594s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.836s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.185s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-318521330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c02d50fa-b673-4cca-a3e4-f28cec903627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b576fa15b79e49849121e6624f09b50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:16:39Z,use_quota=True,user_id='947f9c2bb9be425484a420a372c0e85d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Creating volume c02d50fa-b673-4cca-a3e4-f28cec903627 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:16:54 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c02d50fa-b673-4cca-a3e4-f28cec903627 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:54 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c02d50fa-b673-4cca-a3e4-f28cec903627 1073741824 Jun 25 17:16:54 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eada39fd-391e-4b53-9a51-a058775f297b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90f06417-4304-4aa5-a12c-fcbba9c5e485', 'volume_size': 2, 'source_volid': '7f745695-3810-40f6-a344-567a3bb7b197', 'source_volstatus': 'available'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f7db6a-5077-45ad-990d-2a1786aee564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:54 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Volume volume-90f06417-4304-4aa5-a12c-fcbba9c5e485 (90f06417-4304-4aa5-a12c-fcbba9c5e485): created successfully Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f7db6a-5077-45ad-990d-2a1786aee564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Flow 'volume_create_manager' (5ce58083-30ca-4f31-98e5-7a1ee4a8f1cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:16:54 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-c40d54b3-7a34-4c1d-b214-04ae272d42ab tempest-VolumesCloneTest-1021139331 None] Created volume successfully. Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] Acquiring lock "cinder-90f06417-4304-4aa5-a12c-fcbba9c5e485-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] Lock "cinder-90f06417-4304-4aa5-a12c-fcbba9c5e485-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] Acquiring lock "cinder-quobyte-90f06417-4304-4aa5-a12c-fcbba9c5e485" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] Lock "cinder-quobyte-90f06417-4304-4aa5-a12c-fcbba9c5e485" acquired by "delete_volume" :: waited 0.022s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[730a13f1-3034-434c-83bd-f6fd82cbc5f5]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-90f06417-4304-4aa5-a12c-fcbba9c5e485 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:55 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-90f06417-4304-4aa5-a12c-fcbba9c5e485 Jun 25 17:16:55 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:55 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c02d50fa-b673-4cca-a3e4-f28cec903627 1073741824" returned: 0 in 1.035s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c02d50fa-b673-4cca-a3e4-f28cec903627 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:55 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c02d50fa-b673-4cca-a3e4-f28cec903627 Jun 25 17:16:55 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:55 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-90f06417-4304-4aa5-a12c-fcbba9c5e485" returned: 0 in 0.965s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-90f06417-4304-4aa5-a12c-fcbba9c5e485 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:55 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-90f06417-4304-4aa5-a12c-fcbba9c5e485 Jun 25 17:16:55 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:56 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c02d50fa-b673-4cca-a3e4-f28cec903627" returned: 0 in 0.734s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:16:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e16beb27-96cb-4f00-93b2-2ce1d3ad823b tempest-TestStampPattern-1774809409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.478s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-e16beb27-96cb-4f00-93b2-2ce1d3ad823b tempest-TestStampPattern-1774809409 None] Creating offline snapshot 3c62af85-76aa-499a-b4b1-d2af9b4b9782 of volume 596b3594-2fa6-4d27-9dd4-14c6bc466de5 {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:16:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7871d12f-562d-4ba1-ac23-1fc7088fa097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c02d50fa-b673-4cca-a3e4-f28cec903627', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b9d8e5-8f17-4154-8357-721ed6f2d4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:16:56 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[731fc6f6-7241-41f0-8837-37d3fcbd15fb]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e16beb27-96cb-4f00-93b2-2ce1d3ad823b tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:56 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Volume volume-c02d50fa-b673-4cca-a3e4-f28cec903627 (c02d50fa-b673-4cca-a3e4-f28cec903627): created successfully Jun 25 17:16:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b9d8e5-8f17-4154-8357-721ed6f2d4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:16:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Flow 'volume_create_manager' (86d9f55a-b675-476b-b09b-eef9fb3c70e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:16:56 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-25231c89-608e-436c-8014-658a35b3d7e7 tempest-VolumesServicesTestJSON-198921291 None] Created volume successfully. Jun 25 17:16:56 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 Jun 25 17:16:56 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:56 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-90f06417-4304-4aa5-a12c-fcbba9c5e485" returned: 0 in 0.834s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:56 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] Lock "cinder-quobyte-90f06417-4304-4aa5-a12c-fcbba9c5e485" released by "delete_volume" :: held 1.858s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:56 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] Created reservations ['52cf4d4b-1002-4369-9d6f-8b952eda984c', 'c2be0c72-5a80-4203-b435-35d1a052ae41', 'cf98832e-1140-49b8-ad6c-a7365fa62946', '3b5eba38-5784-47b6-9434-7ce53c6de255'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:57 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e16beb27-96cb-4f00-93b2-2ce1d3ad823b tempest-TestStampPattern-1774809409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5" returned: 0 in 0.976s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e16beb27-96cb-4f00-93b2-2ce1d3ad823b tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:57 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:16:57 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:57 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782 1G Jun 25 17:16:57 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] Acquiring lock "cinder-c02d50fa-b673-4cca-a3e4-f28cec903627-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] Acquiring lock "cinder-7f745695-3810-40f6-a344-567a3bb7b197-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] Lock "cinder-c02d50fa-b673-4cca-a3e4-f28cec903627-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] Lock "cinder-7f745695-3810-40f6-a344-567a3bb7b197-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] Acquiring lock "cinder-quobyte-c02d50fa-b673-4cca-a3e4-f28cec903627" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] Acquiring lock "cinder-quobyte-7f745695-3810-40f6-a344-567a3bb7b197" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] Lock "cinder-quobyte-7f745695-3810-40f6-a344-567a3bb7b197" acquired by "delete_volume" :: waited 0.026s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] Lock "cinder-quobyte-c02d50fa-b673-4cca-a3e4-f28cec903627" acquired by "delete_volume" :: waited 0.066s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa57bff-1ed6-4eab-a211-a06bcd0f60c4]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f3e340-d156-4d28-9a9d-94772020a9e5]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:16:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c02d50fa-b673-4cca-a3e4-f28cec903627 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:57 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 Jun 25 17:16:57 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c02d50fa-b673-4cca-a3e4-f28cec903627 Jun 25 17:16:57 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:57 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:58 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.958s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:58 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:16:58 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] Deleted volume successfully. Jun 25 17:16:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-87e9118e-caa1-449e-8228-81757455e0d6 tempest-VolumesCloneTest-1021139331 None] Lock "cinder-90f06417-4304-4aa5-a12c-fcbba9c5e485-delete_volume" released by "delete_volume" :: held 3.292s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:58 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e16beb27-96cb-4f00-93b2-2ce1d3ad823b tempest-TestStampPattern-1774809409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782 1G" returned: 0 in 1.177s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e16beb27-96cb-4f00-93b2-2ce1d3ad823b tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:58 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782 Jun 25 17:16:58 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:58 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c02d50fa-b673-4cca-a3e4-f28cec903627" returned: 0 in 1.076s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c02d50fa-b673-4cca-a3e4-f28cec903627 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:58 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c02d50fa-b673-4cca-a3e4-f28cec903627 Jun 25 17:16:58 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:58 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197" returned: 0 in 1.165s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:58 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197 Jun 25 17:16:58 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:59 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e16beb27-96cb-4f00-93b2-2ce1d3ad823b tempest-TestStampPattern-1774809409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782" returned: 0 in 0.918s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:59 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-e16beb27-96cb-4f00-93b2-2ce1d3ad823b tempest-TestStampPattern-1774809409 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782 is being set with open permissions: ugo+rw Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e16beb27-96cb-4f00-93b2-2ce1d3ad823b tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:59 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782 Jun 25 17:16:59 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:59 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c02d50fa-b673-4cca-a3e4-f28cec903627" returned: 0 in 0.828s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] Lock "cinder-quobyte-c02d50fa-b673-4cca-a3e4-f28cec903627" released by "delete_volume" :: held 1.960s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] Created reservations ['275fff01-5f67-43d4-8cae-2fea5dfb91d8', 'dda607f0-701f-4a5b-b125-8095055df534', '3113de9e-234a-4ec5-8386-2bb54a01f83e', '592b7f95-6726-401a-979c-0a740317903a'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:16:59 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7f745695-3810-40f6-a344-567a3bb7b197" returned: 0 in 0.896s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] Lock "cinder-quobyte-7f745695-3810-40f6-a344-567a3bb7b197" released by "delete_volume" :: held 2.159s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] Created reservations ['eedd0651-28f3-484c-9344-afeb93a2b190', '0ec7b426-6f6a-486e-b1d5-34f7a8360043', '2495921c-e8b0-428c-9e5b-24665ac6f8bf', 'e8f29c01-10d7-47f6-a6ea-92cbf6d1016b'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:16:59 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:16:59 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:16:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:16:59 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:16:59 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:16:59 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e16beb27-96cb-4f00-93b2-2ce1d3ad823b tempest-TestStampPattern-1774809409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782" returned: 0 in 0.809s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e16beb27-96cb-4f00-93b2-2ce1d3ad823b tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:00 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.info Jun 25 17:17:00 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:00 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.799s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:00 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:17:00 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] Deleted volume successfully. Jun 25 17:17:00 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3b16e144-83be-4c0c-9578-9b4d0e50a6cc tempest-VolumesServicesTestJSON-198921291 None] Lock "cinder-c02d50fa-b673-4cca-a3e4-f28cec903627-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:17:00 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.780s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:00 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:17:00 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] Deleted volume successfully. Jun 25 17:17:00 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f799841f-2aaf-4746-91d1-cdcb1ce74a79 tempest-VolumesCloneTest-1021139331 None] Lock "cinder-7f745695-3810-40f6-a344-567a3bb7b197-delete_volume" released by "delete_volume" :: held 3.272s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:17:00 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e16beb27-96cb-4f00-93b2-2ce1d3ad823b tempest-TestStampPattern-1774809409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.info" returned: 0 in 0.904s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:00 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-e16beb27-96cb-4f00-93b2-2ce1d3ad823b tempest-TestStampPattern-1774809409 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.info is being set with open permissions: ugo+rw Jun 25 17:17:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e16beb27-96cb-4f00-93b2-2ce1d3ad823b tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:00 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.info Jun 25 17:17:00 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:01 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e16beb27-96cb-4f00-93b2-2ce1d3ad823b tempest-TestStampPattern-1774809409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.info" returned: 0 in 0.917s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e16beb27-96cb-4f00-93b2-2ce1d3ad823b tempest-TestStampPattern-1774809409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.845s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.086s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:16:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-902362447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5559afc8-436b-441f-bdab-b669536b082f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8828721a2fae4fee93f9c3371419e7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:16:48Z,use_quota=True,user_id='be3c152e137447f08104c991bb804c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:17:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Creating volume 5559afc8-436b-441f-bdab-b669536b082f {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:17:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:17:01 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:17:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:01 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f 1073741824 Jun 25 17:17:01 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:01 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-e16beb27-96cb-4f00-93b2-2ce1d3ad823b tempest-TestStampPattern-1774809409 None] Create snapshot completed successfully Jun 25 17:17:03 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f 1073741824" returned: 0 in 1.475s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:03 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f Jun 25 17:17:03 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:04 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f" returned: 0 in 0.889s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] <== create_volume: return (2428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:17:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.435s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:04 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Attempting download of ee821749-fc82-479d-867e-eb9bd1200c86 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}])) to volume 5559afc8-436b-441f-bdab-b669536b082f. {{(pid=93869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 17:17:04 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[224c5797-20e5-4221-abf3-8b442b929f81]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:17:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_rtsb9srj {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:04 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_rtsb9srj Jun 25 17:17:04 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:05 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_rtsb9srj" returned: 0 in 1.028s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_rtsb9srj {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:05 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_rtsb9srj Jun 25 17:17:05 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:05 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:17:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Flow 'volume_create_manager' (4285489c-da80-4796-8edb-4ed7df81401f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a971e2-f52f-47c5-b71c-5d0992c95f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a971e2-f52f-47c5-b71c-5d0992c95f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-726292215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4b197b-c916-4e4e-b383-38a39bb6c99e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ce092cf765a4a4583f1bddc2dd5217d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:06Z,use_quota=True,user_id='fd6c45a009ed48dd8f4cd1356649c2c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d074a78-81d3-44b5-aa22-1d1b64909152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d074a78-81d3-44b5-aa22-1d1b64909152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea72532-205e-48ab-a325-d6bb9780548a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea72532-205e-48ab-a325-d6bb9780548a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c4b197b-c916-4e4e-b383-38a39bb6c99e', 'volume_name': 'volume-6c4b197b-c916-4e4e-b383-38a39bb6c99e', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1f4003-be83-4567-bc8e-68ddcdf9dc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1f4003-be83-4567-bc8e-68ddcdf9dc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c4957e4-5738-433b-9e74-5c39905a53a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:06 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Volume 6c4b197b-c916-4e4e-b383-38a39bb6c99e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c4b197b-c916-4e4e-b383-38a39bb6c99e', 'volume_size': 1} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-726292215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4b197b-c916-4e4e-b383-38a39bb6c99e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ce092cf765a4a4583f1bddc2dd5217d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:06Z,use_quota=True,user_id='fd6c45a009ed48dd8f4cd1356649c2c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Creating volume 6c4b197b-c916-4e4e-b383-38a39bb6c99e {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:17:06 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6c4b197b-c916-4e4e-b383-38a39bb6c99e 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:06 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6c4b197b-c916-4e4e-b383-38a39bb6c99e 1073741824 Jun 25 17:17:06 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:06 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_rtsb9srj" returned: 1 in 1.002s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_rtsb9srj' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2c6064-46ef-4209-9a31-7e960c27fbac]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:17:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_9mv385vddevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:06 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_9mv385vddevstack@QuobyteHD Jun 25 17:17:06 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:07 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6c4b197b-c916-4e4e-b383-38a39bb6c99e 1073741824" returned: 0 in 1.073s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6c4b197b-c916-4e4e-b383-38a39bb6c99e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:07 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6c4b197b-c916-4e4e-b383-38a39bb6c99e Jun 25 17:17:07 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:07 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_9mv385vddevstack@QuobyteHD" returned: 0 in 0.997s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:07 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] ee821749-fc82-479d-867e-eb9bd1200c86 was qcow2, converting to raw {{(pid=93869) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 17:17:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_9mv385vddevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:07 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_9mv385vddevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f Jun 25 17:17:07 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:07 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6c4b197b-c916-4e4e-b383-38a39bb6c99e" returned: 0 in 0.790s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:17:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:08 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c4957e4-5738-433b-9e74-5c39905a53a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4b197b-c916-4e4e-b383-38a39bb6c99e', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:08 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a0fb0d-a7b4-44e4-ac68-4e7160daed17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:08 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Volume volume-6c4b197b-c916-4e4e-b383-38a39bb6c99e (6c4b197b-c916-4e4e-b383-38a39bb6c99e): created successfully Jun 25 17:17:08 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a0fb0d-a7b4-44e4-ac68-4e7160daed17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:08 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Flow 'volume_create_manager' (4285489c-da80-4796-8edb-4ed7df81401f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:08 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-30d0a312-1744-43a2-9f85-75718ff99648 tempest-VolumesListTestJSON-1554741197 None] Created volume successfully. Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Flow 'volume_create_manager' (b8b06aa1-8789-4cb4-9eff-8d86f1946569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc391f4-875d-4565-bbf7-f860a709b1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc391f4-875d-4565-bbf7-f860a709b1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1456719964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae297324-c157-44a8-b8ca-35fec5224ca2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ce092cf765a4a4583f1bddc2dd5217d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:10Z,use_quota=True,user_id='fd6c45a009ed48dd8f4cd1356649c2c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332b83fc-b57f-4581-bf34-201921d6f5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332b83fc-b57f-4581-bf34-201921d6f5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b40d086-2e21-453e-95d2-7915a5f256fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b40d086-2e21-453e-95d2-7915a5f256fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae297324-c157-44a8-b8ca-35fec5224ca2', 'volume_name': 'volume-ae297324-c157-44a8-b8ca-35fec5224ca2', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ced373-641e-4eb3-80ff-254cdd6aec8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ced373-641e-4eb3-80ff-254cdd6aec8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e5c1f5-d8cd-4da5-b045-c239f9d732d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:10 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Volume ae297324-c157-44a8-b8ca-35fec5224ca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae297324-c157-44a8-b8ca-35fec5224ca2', 'volume_size': 1} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1456719964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae297324-c157-44a8-b8ca-35fec5224ca2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ce092cf765a4a4583f1bddc2dd5217d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:10Z,use_quota=True,user_id='fd6c45a009ed48dd8f4cd1356649c2c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Creating volume ae297324-c157-44a8-b8ca-35fec5224ca2 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:17:10 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ae297324-c157-44a8-b8ca-35fec5224ca2 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:10 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ae297324-c157-44a8-b8ca-35fec5224ca2 1073741824 Jun 25 17:17:10 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:10 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_9mv385vddevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f" returned: 0 in 3.045s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_9mv385vddevstack@QuobyteHD, size 112.00 MB, duration 3.05 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:17:10 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Converted 112.00 MB image at 36.75 MB/s Jun 25 17:17:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:10 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f 1G Jun 25 17:17:10 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:11 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f 1G" returned: 0 in 1.002s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:11 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f76c74-8b47-4d8e-9be8-064ad2409746]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:17:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:11 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ae297324-c157-44a8-b8ca-35fec5224ca2 1073741824" returned: 0 in 1.513s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:11 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f Jun 25 17:17:11 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ae297324-c157-44a8-b8ca-35fec5224ca2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:11 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ae297324-c157-44a8-b8ca-35fec5224ca2 Jun 25 17:17:11 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:12 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f" returned: 0 in 1.095s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:12 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ae297324-c157-44a8-b8ca-35fec5224ca2" returned: 0 in 0.972s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] <== create_volume: return (2570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:17:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.577s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e5c1f5-d8cd-4da5-b045-c239f9d732d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae297324-c157-44a8-b8ca-35fec5224ca2', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d87b2ec-0316-4214-bfe8-9089b5335d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:12 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f Jun 25 17:17:12 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:12 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Volume volume-ae297324-c157-44a8-b8ca-35fec5224ca2 (ae297324-c157-44a8-b8ca-35fec5224ca2): created successfully Jun 25 17:17:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d87b2ec-0316-4214-bfe8-9089b5335d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Flow 'volume_create_manager' (b8b06aa1-8789-4cb4-9eff-8d86f1946569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:12 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-d9972dc3-73a5-49c2-82c6-cb6de17cdebb tempest-VolumesListTestJSON-1554741197 None] Created volume successfully. Jun 25 17:17:13 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f" returned: 1 in 1.191s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:17:13 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Downloaded image ee821749-fc82-479d-867e-eb9bd1200c86 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}])) to volume 5559afc8-436b-441f-bdab-b669536b082f successfully. {{(pid=93869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 17:17:13 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Temporary image ee821749-fc82-479d-867e-eb9bd1200c86 for user be3c152e137447f08104c991bb804c66 is deleted. {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 17:17:13 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Marking volume 5559afc8-436b-441f-bdab-b669536b082f as bootable. {{(pid=93869) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 17:17:13 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Copying metadata from image ee821749-fc82-479d-867e-eb9bd1200c86 to 5559afc8-436b-441f-bdab-b669536b082f. {{(pid=93869) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 17:17:13 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Creating volume glance metadata for volume 5559afc8-436b-441f-bdab-b669536b082f backed by image ee821749-fc82-479d-867e-eb9bd1200c86 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93869) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb00d68-c73f-4deb-8e52-32893e814eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5559afc8-436b-441f-bdab-b669536b082f', 'volume_size': 1, 'image_id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5ca37abeabcb4631932d73e3b5ba0213', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'created_at': datetime.datetime(2026, 6, 25, 14, 55, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 14, 55, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee821749-fc82-479d-867e-eb9bd1200c86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6f350c-b5d7-488b-96b7-a3ec9fbb56bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:14 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Volume volume-5559afc8-436b-441f-bdab-b669536b082f (5559afc8-436b-441f-bdab-b669536b082f): created successfully Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad6f350c-b5d7-488b-96b7-a3ec9fbb56bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Flow 'volume_create_manager' (ab6b66e3-ee40-4712-a984-af33f8566506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:14 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-bb417b11-00dd-4c67-a6a2-1a67d514b3a8 tempest-VolumesGetTest-1676953946 None] Created volume successfully. Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Flow 'volume_create_manager' (109392b2-98c2-4502-ba9f-3176ec57611b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6384822-2e0d-4870-b41c-bbef35f74aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6384822-2e0d-4870-b41c-bbef35f74aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-100743808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9190ffc-544d-4148-a588-e7e5f21d7280,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ce092cf765a4a4583f1bddc2dd5217d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:14Z,use_quota=True,user_id='fd6c45a009ed48dd8f4cd1356649c2c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515225cf-1e64-4f7d-a364-88abe34b0d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515225cf-1e64-4f7d-a364-88abe34b0d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ca3bdd-b68f-4dd0-9fec-2e8734f49d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ca3bdd-b68f-4dd0-9fec-2e8734f49d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9190ffc-544d-4148-a588-e7e5f21d7280', 'volume_name': 'volume-a9190ffc-544d-4148-a588-e7e5f21d7280', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d24cee-1936-4097-8b44-33614cc677c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d24cee-1936-4097-8b44-33614cc677c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e731d1c-8721-4769-bf89-a893c537b107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:14 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Volume a9190ffc-544d-4148-a588-e7e5f21d7280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9190ffc-544d-4148-a588-e7e5f21d7280', 'volume_size': 1} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-100743808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9190ffc-544d-4148-a588-e7e5f21d7280,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0ce092cf765a4a4583f1bddc2dd5217d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:14Z,use_quota=True,user_id='fd6c45a009ed48dd8f4cd1356649c2c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Creating volume a9190ffc-544d-4148-a588-e7e5f21d7280 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:17:14 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:17:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9190ffc-544d-4148-a588-e7e5f21d7280 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:14 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9190ffc-544d-4148-a588-e7e5f21d7280 1073741824 Jun 25 17:17:14 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:15 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9190ffc-544d-4148-a588-e7e5f21d7280 1073741824" returned: 0 in 1.183s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9190ffc-544d-4148-a588-e7e5f21d7280 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:15 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9190ffc-544d-4148-a588-e7e5f21d7280 Jun 25 17:17:15 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Flow 'volume_create_manager' (e11f1424-11c1-42d5-8fd7-f3a79a874a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d0a81a-24fa-421c-ae7a-767e6d36f385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Flow 'volume_create_manager' (5afa432f-82e5-4765-adb1-a742b5acf2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd63dc61-bee6-49e5-9f2b-7d935717aa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d0a81a-24fa-421c-ae7a-767e6d36f385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1638934724',display_name='tempest-VolumesGetTest-Volume-967351745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19267708-51f1-4bea-bd84-29b84612d9b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828721a2fae4fee93f9c3371419e7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:16Z,use_quota=True,user_id='be3c152e137447f08104c991bb804c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82162215-d0b8-404f-911f-e51963c5164b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82162215-d0b8-404f-911f-e51963c5164b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd5eaeec-285c-4f66-9830-b2430f85cced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd5eaeec-285c-4f66-9830-b2430f85cced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19267708-51f1-4bea-bd84-29b84612d9b4', 'volume_name': 'volume-19267708-51f1-4bea-bd84-29b84612d9b4', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb1d99e-a063-468d-99ee-8ac24508de8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cb1d99e-a063-468d-99ee-8ac24508de8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a46ff1a-4cf5-4f68-96be-ce4358158e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:16 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Volume 19267708-51f1-4bea-bd84-29b84612d9b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19267708-51f1-4bea-bd84-29b84612d9b4', 'volume_size': 1} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd63dc61-bee6-49e5-9f2b-7d935717aa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-608829688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a56af2-02ab-4fbc-bbf3-33ad9c73f532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d76db17d3f44745be355054919981e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:16Z,use_quota=True,user_id='b2ea9d261dd7459cbfd1a9af20397516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a824687-df3a-49e7-9f05-73183cbdf656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a824687-df3a-49e7-9f05-73183cbdf656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c71d96-b894-456b-9f8d-4ee3b6278853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57c71d96-b894-456b-9f8d-4ee3b6278853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63a56af2-02ab-4fbc-bbf3-33ad9c73f532', 'volume_name': 'volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377752ab-657c-4d84-b4e3-b7d6b10668ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377752ab-657c-4d84-b4e3-b7d6b10668ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89716f7d-9ff8-4678-94ff-8f2579899ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:16 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Volume 63a56af2-02ab-4fbc-bbf3-33ad9c73f532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532', 'volume_size': 1} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:16 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9190ffc-544d-4148-a588-e7e5f21d7280" returned: 0 in 0.967s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] <== create_volume: return (2217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.099s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1638934724',display_name='tempest-VolumesGetTest-Volume-967351745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19267708-51f1-4bea-bd84-29b84612d9b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8828721a2fae4fee93f9c3371419e7ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:16Z,use_quota=True,user_id='be3c152e137447f08104c991bb804c66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Creating volume 19267708-51f1-4bea-bd84-29b84612d9b4 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:17:16 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-19267708-51f1-4bea-bd84-29b84612d9b4 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e731d1c-8721-4769-bf89-a893c537b107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9190ffc-544d-4148-a588-e7e5f21d7280', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:16 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-19267708-51f1-4bea-bd84-29b84612d9b4 1073741824 Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ad5903-7f19-451d-88bb-2e45cebdb1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:16 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:16 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Volume volume-a9190ffc-544d-4148-a588-e7e5f21d7280 (a9190ffc-544d-4148-a588-e7e5f21d7280): created successfully Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ad5903-7f19-451d-88bb-2e45cebdb1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Flow 'volume_create_manager' (109392b2-98c2-4502-ba9f-3176ec57611b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:17:16 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-5bb78b5a-120d-4066-b4c8-5500f2b5574d tempest-VolumesListTestJSON-1554741197 None] Created volume successfully. Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Flow 'volume_create_manager' (3e4b07b7-cce1-449a-a521-bf9ab6b51d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7280a940-4878-449b-a1b4-61b6ecc52e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7280a940-4878-449b-a1b4-61b6ecc52e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1298637300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a950d2-d71c-483b-bb14-833002afc18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='583e61b1188d4209a862b08de13846a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3c62af85-76aa-499a-b4b1-d2af9b4b9782,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:17Z,use_quota=True,user_id='62179633b723445e8a191994e2dccea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff46cc07-0401-4836-88d5-3ad7613428c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff46cc07-0401-4836-88d5-3ad7613428c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c03681-1a2e-420e-9479-11579aac1c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c03681-1a2e-420e-9479-11579aac1c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '34a950d2-d71c-483b-bb14-833002afc18e', 'volume_name': 'volume-34a950d2-d71c-483b-bb14-833002afc18e', 'volume_size': 1, 'snapshot_id': '3c62af85-76aa-499a-b4b1-d2af9b4b9782'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c25d711-ae07-4982-8ad4-b4c0c46761d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c25d711-ae07-4982-8ad4-b4c0c46761d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef412fd-00f2-443c-9db7-ab9ccf4e3cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:16 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Volume 34a950d2-d71c-483b-bb14-833002afc18e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-34a950d2-d71c-483b-bb14-833002afc18e', 'volume_size': 1, 'snapshot_id': '3c62af85-76aa-499a-b4b1-d2af9b4b9782'} Jun 25 17:17:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:17 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-19267708-51f1-4bea-bd84-29b84612d9b4 1073741824" returned: 0 in 1.179s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-19267708-51f1-4bea-bd84-29b84612d9b4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:17 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-19267708-51f1-4bea-bd84-29b84612d9b4 Jun 25 17:17:17 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:18 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-19267708-51f1-4bea-bd84-29b84612d9b4" returned: 0 in 0.889s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:18 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] <== create_volume: return (2117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:17:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.122s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.170s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:18 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-608829688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a56af2-02ab-4fbc-bbf3-33ad9c73f532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d76db17d3f44745be355054919981e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:16Z,use_quota=True,user_id='b2ea9d261dd7459cbfd1a9af20397516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:17:18 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Creating volume 63a56af2-02ab-4fbc-bbf3-33ad9c73f532 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:17:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:18 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:18 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:18 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:17:18 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:17:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:18 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a46ff1a-4cf5-4f68-96be-ce4358158e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19267708-51f1-4bea-bd84-29b84612d9b4', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:18 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532 1073741824 Jun 25 17:17:18 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:18 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4354c8-04ce-4c98-8c8e-2fa8abbd8c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:18 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Volume volume-19267708-51f1-4bea-bd84-29b84612d9b4 (19267708-51f1-4bea-bd84-29b84612d9b4): created successfully Jun 25 17:17:18 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4354c8-04ce-4c98-8c8e-2fa8abbd8c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:18 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Flow 'volume_create_manager' (e11f1424-11c1-42d5-8fd7-f3a79a874a15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:19 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-7ea0f4c4-0ba1-4088-8890-28f512565a29 tempest-VolumesGetTest-1676953946 None] Created volume successfully. Jun 25 17:17:19 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] Acquiring lock "cinder-19267708-51f1-4bea-bd84-29b84612d9b4-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:17:19 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] Lock "cinder-19267708-51f1-4bea-bd84-29b84612d9b4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:17:19 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] Acquiring lock "cinder-quobyte-19267708-51f1-4bea-bd84-29b84612d9b4" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:17:19 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] Lock "cinder-quobyte-19267708-51f1-4bea-bd84-29b84612d9b4" acquired by "delete_volume" :: waited 0.030s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:17:19 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6d2d74-4921-478c-a340-e5db723d4a1e]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:17:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-19267708-51f1-4bea-bd84-29b84612d9b4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:19 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-19267708-51f1-4bea-bd84-29b84612d9b4 Jun 25 17:17:19 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:20 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532 1073741824" returned: 0 in 1.188s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:20 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532 Jun 25 17:17:20 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] Acquiring lock "cinder-a9190ffc-544d-4148-a588-e7e5f21d7280-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:17:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] Lock "cinder-a9190ffc-544d-4148-a588-e7e5f21d7280-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:17:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] Acquiring lock "cinder-quobyte-a9190ffc-544d-4148-a588-e7e5f21d7280" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:17:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] Lock "cinder-quobyte-a9190ffc-544d-4148-a588-e7e5f21d7280" acquired by "delete_volume" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:17:20 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc76fe7-52d3-4835-97db-0563c3dd66ef]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:17:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9190ffc-544d-4148-a588-e7e5f21d7280 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:20 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-19267708-51f1-4bea-bd84-29b84612d9b4" returned: 0 in 0.945s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-19267708-51f1-4bea-bd84-29b84612d9b4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:20 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-19267708-51f1-4bea-bd84-29b84612d9b4 Jun 25 17:17:20 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:20 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9190ffc-544d-4148-a588-e7e5f21d7280 Jun 25 17:17:20 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:21 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532" returned: 0 in 1.002s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] <== create_volume: return (2249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.253s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.146s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Acquiring lock "cinder-quobyte-3c62af85-76aa-499a-b4b1-d2af9b4b9782-34a950d2-d71c-483b-bb14-833002afc18e" by "_create_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89716f7d-9ff8-4678-94ff-8f2579899ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (883d9c19-5863-43c9-a70b-e48ac28e7dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Lock "cinder-quobyte-3c62af85-76aa-499a-b4b1-d2af9b4b9782-34a950d2-d71c-483b-bb14-833002afc18e" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Creating volume 34a950d2-d71c-483b-bb14-833002afc18e from snapshot 3c62af85-76aa-499a-b4b1-d2af9b4b9782 {{(pid=93869) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Acquiring lock "cinder-quobyte-34a950d2-d71c-483b-bb14-833002afc18e" by "_copy_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:17:21 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Volume volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532 (63a56af2-02ab-4fbc-bbf3-33ad9c73f532): created successfully Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (883d9c19-5863-43c9-a70b-e48ac28e7dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Flow 'volume_create_manager' (5afa432f-82e5-4765-adb1-a742b5acf2b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Lock "cinder-quobyte-34a950d2-d71c-483b-bb14-833002afc18e" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] snapshot: 3c62af85-76aa-499a-b4b1-d2af9b4b9782, volume: 34a950d2-d71c-483b-bb14-833002afc18e, {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 17:17:21 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-12e2a759-00e9-483b-b186-bb2b5d8ac75e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Created volume successfully. Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[122ad880-ffc4-4a0b-8927-a6ef2015bea3]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:21 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782 Jun 25 17:17:21 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:21 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-19267708-51f1-4bea-bd84-29b84612d9b4" returned: 0 in 0.864s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] Lock "cinder-quobyte-19267708-51f1-4bea-bd84-29b84612d9b4" released by "delete_volume" :: held 1.881s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] Created reservations ['3de0fd69-65cc-4fa8-9036-d8de659f0a22', 'c0630cdc-be1b-4bfc-b1ad-95b532d9e1ee', '313775a4-cf9d-452c-96cf-6c89a3e465b7', '21d9f5a1-8e96-4e4e-9e26-967cce86b1ce'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:17:21 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9190ffc-544d-4148-a588-e7e5f21d7280" returned: 0 in 1.162s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9190ffc-544d-4148-a588-e7e5f21d7280 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:21 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9190ffc-544d-4148-a588-e7e5f21d7280 Jun 25 17:17:21 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:21 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:17:21 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-faf150a1-be8f-4dc2-a464-af4c5f816326 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:22 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] Acquiring lock "cinder-5559afc8-436b-441f-bdab-b669536b082f-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:17:22 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] Lock "cinder-5559afc8-436b-441f-bdab-b669536b082f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:17:22 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] Acquiring lock "cinder-quobyte-5559afc8-436b-441f-bdab-b669536b082f" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:17:22 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] Lock "cinder-quobyte-5559afc8-436b-441f-bdab-b669536b082f" acquired by "delete_volume" :: waited 0.020s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:17:22 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[69370bbd-8022-487b-b9b4-9a8963b63c01]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:17:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:22 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f Jun 25 17:17:22 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:22 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782" returned: 0 in 1.419s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:22 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:17:22 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] will copy from snapshot at /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 17:17:22 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Creating direct copy from snapshot {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 17:17:22 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32992ee-d98c-4197-a30f-c6d58c8aea29]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:17:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:22 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.063s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:22 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:17:22 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] Deleted volume successfully. Jun 25 17:17:22 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-88f4a76e-ed6c-4ec4-b6ed-2793f353fea4 tempest-VolumesGetTest-1676953946 None] Lock "cinder-19267708-51f1-4bea-bd84-29b84612d9b4-delete_volume" released by "delete_volume" :: held 3.361s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:17:22 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9190ffc-544d-4148-a588-e7e5f21d7280" returned: 0 in 1.226s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:22 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] Lock "cinder-quobyte-a9190ffc-544d-4148-a588-e7e5f21d7280" released by "delete_volume" :: held 2.448s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:17:23 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 Jun 25 17:17:23 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:23 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] Created reservations ['88333fcd-87d9-4e60-9142-b5ffa345937a', 'e20af8a8-9454-4ae9-a54a-eb5c6b287d23', 'da314c8c-d0dd-4b81-baeb-f9e22581682c', '2286338f-7055-4d91-a59d-df4c1eb5e9c6'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:17:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:23 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:17:23 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:23 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f" returned: 0 in 1.229s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:23 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f Jun 25 17:17:23 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] Acquiring lock "cinder-ae297324-c157-44a8-b8ca-35fec5224ca2-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:17:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] Lock "cinder-ae297324-c157-44a8-b8ca-35fec5224ca2-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:17:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] Acquiring lock "cinder-quobyte-ae297324-c157-44a8-b8ca-35fec5224ca2" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:17:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] Lock "cinder-quobyte-ae297324-c157-44a8-b8ca-35fec5224ca2" acquired by "delete_volume" :: waited 0.022s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:17:24 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5" returned: 0 in 1.640s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:24 devstack cinder-volume[93869]: DEBUG cinder.utils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Path /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-34a950d2-d71c-483b-bb14-833002afc18e not found in is_blk_device check {{(pid=93869) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 17:17:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-34a950d2-d71c-483b-bb14-833002afc18e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:24 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[77354a79-6009-414a-b7d3-2c9a03ce9776]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:17:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ae297324-c157-44a8-b8ca-35fec5224ca2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:24 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-34a950d2-d71c-483b-bb14-833002afc18e Jun 25 17:17:24 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:24 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.284s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:24 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:17:24 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] Deleted volume successfully. Jun 25 17:17:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b98d0f27-1290-4c02-aac5-88d65a0c3d14 tempest-VolumesListTestJSON-1554741197 None] Lock "cinder-a9190ffc-544d-4148-a588-e7e5f21d7280-delete_volume" released by "delete_volume" :: held 4.146s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:17:24 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ae297324-c157-44a8-b8ca-35fec5224ca2 Jun 25 17:17:24 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:24 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f" returned: 1 in 1.357s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:17:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:24 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f Jun 25 17:17:24 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:26 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ae297324-c157-44a8-b8ca-35fec5224ca2" returned: 0 in 2.197s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ae297324-c157-44a8-b8ca-35fec5224ca2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:26 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5559afc8-436b-441f-bdab-b669536b082f" returned: 0 in 1.847s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:26 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ae297324-c157-44a8-b8ca-35fec5224ca2 Jun 25 17:17:26 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] Lock "cinder-quobyte-5559afc8-436b-441f-bdab-b669536b082f" released by "delete_volume" :: held 4.601s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:17:27 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] Created reservations ['25f1ad5c-8bd7-4399-a01b-caa8e1324e5d', 'f3b08e77-dbe3-41ed-b52c-0068a167184d', '9e3507b2-94d2-4f75-9d18-afe607b32528', '518163c4-5a43-4a2a-ac63-756fba6511d5'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:17:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:27 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:17:27 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:28 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-ae297324-c157-44a8-b8ca-35fec5224ca2" returned: 0 in 2.109s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:28 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] Lock "cinder-quobyte-ae297324-c157-44a8-b8ca-35fec5224ca2" released by "delete_volume" :: held 4.499s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:17:29 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] Created reservations ['ca901d47-87c3-4995-a886-45044b098323', '0df1c570-515c-43d2-9c46-ccfd8adbf5f7', '103cb348-03dc-41f6-ac41-2fa4b1cea01f', '5442ab90-bcc7-4194-85bc-39e82d0c4fd3'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:17:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:29 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:29 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:29 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 2.356s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:29 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:17:29 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:17:29 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:29 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] Deleted volume successfully. Jun 25 17:17:29 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8f6128ba-55bd-48a5-b891-e3b4e1db0f46 tempest-VolumesGetTest-1676953946 None] Lock "cinder-5559afc8-436b-441f-bdab-b669536b082f-delete_volume" released by "delete_volume" :: held 7.683s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:17:31 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] Acquiring lock "cinder-6c4b197b-c916-4e4e-b383-38a39bb6c99e-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:17:31 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] Lock "cinder-6c4b197b-c916-4e4e-b383-38a39bb6c99e-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:17:31 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] Acquiring lock "cinder-quobyte-6c4b197b-c916-4e4e-b383-38a39bb6c99e" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:17:31 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] Lock "cinder-quobyte-6c4b197b-c916-4e4e-b383-38a39bb6c99e" acquired by "delete_volume" :: waited 0.061s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:17:31 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d68e3c-bc5c-4132-81dc-b89292fe3458]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:17:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6c4b197b-c916-4e4e-b383-38a39bb6c99e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:31 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6c4b197b-c916-4e4e-b383-38a39bb6c99e Jun 25 17:17:31 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:32 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 2.488s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:32 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:17:32 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] Deleted volume successfully. Jun 25 17:17:32 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ad8991c9-cb67-44c3-be37-11359b5db3a5 tempest-VolumesListTestJSON-1554741197 None] Lock "cinder-ae297324-c157-44a8-b8ca-35fec5224ca2-delete_volume" released by "delete_volume" :: held 7.926s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:17:33 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-34a950d2-d71c-483b-bb14-833002afc18e" returned: 0 in 8.974s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:33 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41f2c14-c0ac-406b-bcf9-01db15514d28]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:17:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:33 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 Jun 25 17:17:33 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:33 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6c4b197b-c916-4e4e-b383-38a39bb6c99e" returned: 0 in 2.128s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6c4b197b-c916-4e4e-b383-38a39bb6c99e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:33 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6c4b197b-c916-4e4e-b383-38a39bb6c99e Jun 25 17:17:33 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:34 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6c4b197b-c916-4e4e-b383-38a39bb6c99e" returned: 0 in 0.807s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:34 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] Lock "cinder-quobyte-6c4b197b-c916-4e4e-b383-38a39bb6c99e" released by "delete_volume" :: held 3.071s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:17:34 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] Created reservations ['f2ca0dab-e4ae-41db-803b-ce67c76fd951', '2fea40b7-3405-4461-bac7-1381a67588a2', 'd8707016-0fc2-4c1f-95e8-2f27d9abb974', 'd95e6947-7eee-4c11-941f-50d4764b19e0'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:17:34 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5" returned: 0 in 1.269s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:34 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Image conversion details: src /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5, size 1024.00 MB, duration 8.98 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-34a950d2-d71c-483b-bb14-833002afc18e {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:17:34 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Converted 1024.00 MB image at 114.09 MB/s Jun 25 17:17:34 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-34a950d2-d71c-483b-bb14-833002afc18e is being set with open permissions: ugo+rw Jun 25 17:17:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-34a950d2-d71c-483b-bb14-833002afc18e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:34 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-34a950d2-d71c-483b-bb14-833002afc18e Jun 25 17:17:34 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:34 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:34 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:34 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:17:34 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:35 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:35 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.008s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:35 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:17:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-34a950d2-d71c-483b-bb14-833002afc18e" returned: 0 in 1.119s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:35 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] Deleted volume successfully. Jun 25 17:17:35 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Lock "cinder-quobyte-34a950d2-d71c-483b-bb14-833002afc18e" released by "_copy_volume_from_snapshot" :: held 14.612s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:17:35 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Lock "cinder-quobyte-3c62af85-76aa-499a-b4b1-d2af9b4b9782-34a950d2-d71c-483b-bb14-833002afc18e" released by "_create_volume_from_snapshot" :: held 14.703s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:17:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.754s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-faf150a1-be8f-4dc2-a464-af4c5f816326 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.850s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:35 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e3810de8-c82a-41db-b0d3-660140062c79 tempest-VolumesListTestJSON-1554741197 None] Lock "cinder-6c4b197b-c916-4e4e-b383-38a39bb6c99e-delete_volume" released by "delete_volume" :: held 4.792s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:17:35 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-faf150a1-be8f-4dc2-a464-af4c5f816326 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Creating offline snapshot 0b41d072-fa67-4b7e-a6ea-ab02010a2d30 of volume 63a56af2-02ab-4fbc-bbf3-33ad9c73f532 {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:17:35 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ef412fd-00f2-443c-9db7-ab9ccf4e3cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a950d2-d71c-483b-bb14-833002afc18e', 'volume_size': 1, 'snapshot_id': '3c62af85-76aa-499a-b4b1-d2af9b4b9782'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:35 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9642d2ff-9702-4727-ab5b-abe00c8f337c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:36 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[98709807-60aa-4815-9b52-18aebaede743]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:17:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-faf150a1-be8f-4dc2-a464-af4c5f816326 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:36 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Volume volume-34a950d2-d71c-483b-bb14-833002afc18e (34a950d2-d71c-483b-bb14-833002afc18e): created successfully Jun 25 17:17:36 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9642d2ff-9702-4727-ab5b-abe00c8f337c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:36 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Flow 'volume_create_manager' (3e4b07b7-cce1-449a-a521-bf9ab6b51d7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:36 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-e2296754-b345-4e88-b82f-edd6f9594cda tempest-TestStampPattern-1774809409 None] Created volume successfully. Jun 25 17:17:36 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532 Jun 25 17:17:36 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:37 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-faf150a1-be8f-4dc2-a464-af4c5f816326 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532" returned: 0 in 1.483s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-faf150a1-be8f-4dc2-a464-af4c5f816326 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:37 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30 1G Jun 25 17:17:37 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:39 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-faf150a1-be8f-4dc2-a464-af4c5f816326 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30 1G" returned: 0 in 1.554s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-faf150a1-be8f-4dc2-a464-af4c5f816326 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:39 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30 Jun 25 17:17:39 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:40 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-faf150a1-be8f-4dc2-a464-af4c5f816326 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30" returned: 0 in 1.597s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:40 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-faf150a1-be8f-4dc2-a464-af4c5f816326 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30 is being set with open permissions: ugo+rw Jun 25 17:17:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-faf150a1-be8f-4dc2-a464-af4c5f816326 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:40 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30 Jun 25 17:17:40 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:41 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:17:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Flow 'volume_create_manager' (a8bbc370-123e-4816-8b9d-14acff45f1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d1904e-4a10-4ba3-9997-3bbe71db5cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d1904e-4a10-4ba3-9997-3bbe71db5cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1540714239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a417423-3467-4f3c-a43c-8e19ea0d0911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b6ebfed18846f4b4143fe6b896cdc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:42Z,use_quota=True,user_id='48908a30d13d407eb049649e0e08e390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d471f4-9268-4aa0-9328-2fc42134881c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d471f4-9268-4aa0-9328-2fc42134881c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8640956-f383-4e74-a616-7d71f261f748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8640956-f383-4e74-a616-7d71f261f748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a417423-3467-4f3c-a43c-8e19ea0d0911', 'volume_name': 'volume-4a417423-3467-4f3c-a43c-8e19ea0d0911', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbcbbf61-1f6c-41ce-901d-846966f820f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbcbbf61-1f6c-41ce-901d-846966f820f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616dc9c8-2c1d-4484-8083-3dac8b37e2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:42 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Volume 4a417423-3467-4f3c-a43c-8e19ea0d0911: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a417423-3467-4f3c-a43c-8e19ea0d0911', 'volume_size': 1} Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Flow 'volume_create_manager' (bae3cb3d-b15e-40bc-9f3d-1aa9953bcf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8f73f9-91b0-473a-973b-692301450664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8f73f9-91b0-473a-973b-692301450664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-18781136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3244c80-4e4b-46e7-b5e5-13306048a8e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51cbb2beb8c4dc9a20cf84668a782d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:42Z,use_quota=True,user_id='b47d479926f64a50943db6a7af32c825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34950dba-09fc-4dd3-a8c6-bdcd1d4f41a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34950dba-09fc-4dd3-a8c6-bdcd1d4f41a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d93f484-f9a2-4663-bcf9-b08b951cba33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d93f484-f9a2-4663-bcf9-b08b951cba33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3244c80-4e4b-46e7-b5e5-13306048a8e1', 'volume_name': 'volume-b3244c80-4e4b-46e7-b5e5-13306048a8e1', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5352ebc3-cc62-4f1b-97ea-2e41c398c589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:42 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5352ebc3-cc62-4f1b-97ea-2e41c398c589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b0dce2-5aea-476a-a8a6-67654766c696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:42 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Volume b3244c80-4e4b-46e7-b5e5-13306048a8e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3244c80-4e4b-46e7-b5e5-13306048a8e1', 'volume_size': 1} Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-faf150a1-be8f-4dc2-a464-af4c5f816326 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30" returned: 0 in 1.821s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-faf150a1-be8f-4dc2-a464-af4c5f816326 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:42 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.info Jun 25 17:17:42 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Flow 'volume_create_manager' (cb19a83f-176b-4f5e-b6d8-e1936303c1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51a1d04-8b99-488c-80bd-8725839f77bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51a1d04-8b99-488c-80bd-8725839f77bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-679112844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e79090e-8901-41bb-b4eb-9bf73c5357a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51cbb2beb8c4dc9a20cf84668a782d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:43Z,use_quota=True,user_id='b47d479926f64a50943db6a7af32c825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd5525f-a523-4a91-bdff-16efb5bb596e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd5525f-a523-4a91-bdff-16efb5bb596e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c29dde-9047-4243-af95-a13f28893c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c29dde-9047-4243-af95-a13f28893c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e79090e-8901-41bb-b4eb-9bf73c5357a3', 'volume_name': 'volume-0e79090e-8901-41bb-b4eb-9bf73c5357a3', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3ca1c8-2113-490b-9001-310c930292a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3ca1c8-2113-490b-9001-310c930292a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b303485-e9d8-4ee6-8d1e-8aa3ec75f50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:43 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Volume 0e79090e-8901-41bb-b4eb-9bf73c5357a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e79090e-8901-41bb-b4eb-9bf73c5357a3', 'volume_size': 1} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Flow 'volume_create_manager' (1e6c03fd-7a6a-4a20-a35d-dafb2dee0674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900a3fc9-76dd-4484-ac0a-62aca8909b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900a3fc9-76dd-4484-ac0a-62aca8909b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-251958916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570d2307-184b-4e47-a4a0-91649f7e0d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51cbb2beb8c4dc9a20cf84668a782d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:44Z,use_quota=True,user_id='b47d479926f64a50943db6a7af32c825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888297a3-8887-4bf0-a738-b19d198811db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888297a3-8887-4bf0-a738-b19d198811db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4030d6-896f-4afe-a06f-86488076d0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4030d6-896f-4afe-a06f-86488076d0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '570d2307-184b-4e47-a4a0-91649f7e0d2f', 'volume_name': 'volume-570d2307-184b-4e47-a4a0-91649f7e0d2f', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c37a0c0-95a2-4c5c-ae45-6e02547de6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c37a0c0-95a2-4c5c-ae45-6e02547de6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa483dd5-9777-4645-a831-de16b499ac4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:43 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Volume 570d2307-184b-4e47-a4a0-91649f7e0d2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-570d2307-184b-4e47-a4a0-91649f7e0d2f', 'volume_size': 1} Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:43 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-faf150a1-be8f-4dc2-a464-af4c5f816326 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.info" returned: 0 in 1.357s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:43 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-faf150a1-be8f-4dc2-a464-af4c5f816326 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.info is being set with open permissions: ugo+rw Jun 25 17:17:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-faf150a1-be8f-4dc2-a464-af4c5f816326 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:43 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.info Jun 25 17:17:43 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:17:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:44 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:17:44 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:44 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:17:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Flow 'volume_create_manager' (09547704-ab7b-430c-b776-9fd64b1031d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21acba2b-200e-45e8-a4fc-43ea9cc4b78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21acba2b-200e-45e8-a4fc-43ea9cc4b78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1797022035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74ee81fc-54b3-4dfe-957b-a22da5feeaaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51cbb2beb8c4dc9a20cf84668a782d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:44Z,use_quota=True,user_id='b47d479926f64a50943db6a7af32c825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6dc62f-be70-48be-a33d-051731e1caef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6dc62f-be70-48be-a33d-051731e1caef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075471f7-be15-453d-ab05-76a8b0a9fc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075471f7-be15-453d-ab05-76a8b0a9fc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74ee81fc-54b3-4dfe-957b-a22da5feeaaf', 'volume_name': 'volume-74ee81fc-54b3-4dfe-957b-a22da5feeaaf', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee6f89b-8125-49f6-a00a-e9721a8934a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee6f89b-8125-49f6-a00a-e9721a8934a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3df9728-4f72-46c0-8d6c-b36ecbf29d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:44 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Volume 74ee81fc-54b3-4dfe-957b-a22da5feeaaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74ee81fc-54b3-4dfe-957b-a22da5feeaaf', 'volume_size': 1} Jun 25 17:17:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Flow 'volume_create_manager' (99c5b06b-c1ae-462d-a14a-e706319fc80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b660001e-784a-4682-a1a4-f2293a6c4bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b660001e-784a-4682-a1a4-f2293a6c4bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1924540195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9636b2b-d467-4c55-ba3d-b51aae58279d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51cbb2beb8c4dc9a20cf84668a782d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:45Z,use_quota=True,user_id='b47d479926f64a50943db6a7af32c825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec85ab5-36c8-4ed7-9fd1-f9e48c7b1768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec85ab5-36c8-4ed7-9fd1-f9e48c7b1768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5cdbae-4b1d-4d76-8038-898255ff32d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de5cdbae-4b1d-4d76-8038-898255ff32d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9636b2b-d467-4c55-ba3d-b51aae58279d', 'volume_name': 'volume-a9636b2b-d467-4c55-ba3d-b51aae58279d', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e9c9d9-bc94-468a-bb06-cfb7fab073b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e9c9d9-bc94-468a-bb06-cfb7fab073b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27af7dc-b4f6-4932-87d3-e32752e91855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:45 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Volume a9636b2b-d467-4c55-ba3d-b51aae58279d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9636b2b-d467-4c55-ba3d-b51aae58279d', 'volume_size': 1} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:45 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.365s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 28 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:17:45 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-faf150a1-be8f-4dc2-a464-af4c5f816326 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.info" returned: 0 in 1.761s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-faf150a1-be8f-4dc2-a464-af4c5f816326 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.826s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.637s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1540714239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a417423-3467-4f3c-a43c-8e19ea0d0911,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58b6ebfed18846f4b4143fe6b896cdc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:42Z,use_quota=True,user_id='48908a30d13d407eb049649e0e08e390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Creating volume 4a417423-3467-4f3c-a43c-8e19ea0d0911 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:17:45 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4a417423-3467-4f3c-a43c-8e19ea0d0911 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=78,cinder:INSERT=26,cinder:UPDATE=95,cinder:DELETE=8 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:17:45 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4a417423-3467-4f3c-a43c-8e19ea0d0911 1073741824 Jun 25 17:17:45 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:45 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:DELETE=11,cinder:UPDATE=99,cinder:SELECT=75,cinder:INSERT=29 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:17:45 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-faf150a1-be8f-4dc2-a464-af4c5f816326 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Create snapshot completed successfully Jun 25 17:17:46 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Acquiring lock "cinder-0b41d072-fa67-4b7e-a6ea-ab02010a2d30-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:17:46 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Lock "cinder-0b41d072-fa67-4b7e-a6ea-ab02010a2d30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:17:46 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Acquiring lock "cinder-quobyte-63a56af2-02ab-4fbc-bbf3-33ad9c73f532" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:17:46 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Lock "cinder-quobyte-63a56af2-02ab-4fbc-bbf3-33ad9c73f532" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:17:46 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Acquiring lock "cinder-quobyte-0b41d072-fa67-4b7e-a6ea-ab02010a2d30" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:17:46 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Lock "cinder-quobyte-0b41d072-fa67-4b7e-a6ea-ab02010a2d30" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:17:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Deleting offline snapshot 0b41d072-fa67-4b7e-a6ea-ab02010a2d30 of volume 63a56af2-02ab-4fbc-bbf3-33ad9c73f532 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:17:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] snapshot_file for this snap is: volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:17:46 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf1770b-3c1b-4155-9a54-091f4b54b731]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:17:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:46 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4a417423-3467-4f3c-a43c-8e19ea0d0911 1073741824" returned: 0 in 1.226s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:46 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30 Jun 25 17:17:46 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4a417423-3467-4f3c-a43c-8e19ea0d0911 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:47 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4a417423-3467-4f3c-a43c-8e19ea0d0911 Jun 25 17:17:47 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:47 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4a417423-3467-4f3c-a43c-8e19ea0d0911" returned: 0 in 0.775s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.086s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.304s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-18781136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3244c80-4e4b-46e7-b5e5-13306048a8e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51cbb2beb8c4dc9a20cf84668a782d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:42Z,use_quota=True,user_id='b47d479926f64a50943db6a7af32c825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Creating volume b3244c80-4e4b-46e7-b5e5-13306048a8e1 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:47 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:17:47 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b3244c80-4e4b-46e7-b5e5-13306048a8e1 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30" returned: 0 in 1.042s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:17:47 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b3244c80-4e4b-46e7-b5e5-13306048a8e1 1073741824 Jun 25 17:17:47 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616dc9c8-2c1d-4484-8083-3dac8b37e2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a417423-3467-4f3c-a43c-8e19ea0d0911', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891e0b8c-adf4-41c4-9ef3-964d734da14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[909aa157-1708-4cc0-9524-d5d349cb783e]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:47 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Volume volume-4a417423-3467-4f3c-a43c-8e19ea0d0911 (4a417423-3467-4f3c-a43c-8e19ea0d0911): created successfully Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891e0b8c-adf4-41c4-9ef3-964d734da14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Flow 'volume_create_manager' (a8bbc370-123e-4816-8b9d-14acff45f1bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:47 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-13d433ec-f4f1-41f6-8830-bf868513558d tempest-VolumesNegativeTest-1836645998 None] Created volume successfully. Jun 25 17:17:48 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532 Jun 25 17:17:48 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:49 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532" returned: 0 in 1.193s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:49 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b3244c80-4e4b-46e7-b5e5-13306048a8e1 1073741824" returned: 0 in 1.318s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:49 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30 Jun 25 17:17:49 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b3244c80-4e4b-46e7-b5e5-13306048a8e1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:49 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b3244c80-4e4b-46e7-b5e5-13306048a8e1 Jun 25 17:17:49 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:50 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30" returned: 0 in 1.074s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:50 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30 Jun 25 17:17:50 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:50 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b3244c80-4e4b-46e7-b5e5-13306048a8e1" returned: 0 in 1.106s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] <== create_volume: return (2525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:17:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.530s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.264s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-679112844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e79090e-8901-41bb-b4eb-9bf73c5357a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51cbb2beb8c4dc9a20cf84668a782d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:43Z,use_quota=True,user_id='b47d479926f64a50943db6a7af32c825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:17:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Creating volume 0e79090e-8901-41bb-b4eb-9bf73c5357a3 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:17:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:17:50 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:17:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0e79090e-8901-41bb-b4eb-9bf73c5357a3 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b0dce2-5aea-476a-a8a6-67654766c696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3244c80-4e4b-46e7-b5e5-13306048a8e1', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:50 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0e79090e-8901-41bb-b4eb-9bf73c5357a3 1073741824 Jun 25 17:17:50 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72cb9a9c-c6a3-4c0e-8bd2-54c2e1f1b419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:50 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Volume volume-b3244c80-4e4b-46e7-b5e5-13306048a8e1 (b3244c80-4e4b-46e7-b5e5-13306048a8e1): created successfully Jun 25 17:17:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72cb9a9c-c6a3-4c0e-8bd2-54c2e1f1b419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Flow 'volume_create_manager' (bae3cb3d-b15e-40bc-9f3d-1aa9953bcf95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:50 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-180ffbdc-22e7-43c6-a92b-c752eb5550e2 tempest-CreateVolumesFromImageTest-1944119671 None] Created volume successfully. Jun 25 17:17:51 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532.0b41d072-fa67-4b7e-a6ea-ab02010a2d30" returned: 0 in 1.061s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:51 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Lock "cinder-quobyte-0b41d072-fa67-4b7e-a6ea-ab02010a2d30" released by "_delete_snapshot" :: held 4.549s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:17:51 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Lock "cinder-quobyte-63a56af2-02ab-4fbc-bbf3-33ad9c73f532" released by "delete_snapshot" :: held 4.590s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:17:51 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Created reservations ['2b5d20b9-976d-4760-9609-7a035415867b', 'ac1ed6c9-c600-41ba-984f-ff48e86b9815', 'd75a782f-96d6-4d57-b987-d858e8068e87', '2c827510-f2b9-4ace-9a0e-40ca96700a5e'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:17:51 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Delete snapshot completed successfully. Jun 25 17:17:51 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ebedf968-85a6-4d19-aee4-57864e79f604 tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Lock "cinder-0b41d072-fa67-4b7e-a6ea-ab02010a2d30-delete_snapshot" released by "delete_snapshot" :: held 4.795s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:17:51 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0e79090e-8901-41bb-b4eb-9bf73c5357a3 1073741824" returned: 0 in 1.341s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0e79090e-8901-41bb-b4eb-9bf73c5357a3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:51 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0e79090e-8901-41bb-b4eb-9bf73c5357a3 Jun 25 17:17:51 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Acquiring lock "cinder-63a56af2-02ab-4fbc-bbf3-33ad9c73f532-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:17:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Lock "cinder-63a56af2-02ab-4fbc-bbf3-33ad9c73f532-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:17:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Acquiring lock "cinder-quobyte-63a56af2-02ab-4fbc-bbf3-33ad9c73f532" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:17:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Lock "cinder-quobyte-63a56af2-02ab-4fbc-bbf3-33ad9c73f532" acquired by "delete_volume" :: waited 0.026s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:17:52 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6f02c2-27a6-499b-8ef5-fb66e122fd31]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:17:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:52 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532 Jun 25 17:17:52 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:52 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0e79090e-8901-41bb-b4eb-9bf73c5357a3" returned: 0 in 1.205s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] <== create_volume: return (2620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:17:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.623s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.230s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-251958916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570d2307-184b-4e47-a4a0-91649f7e0d2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51cbb2beb8c4dc9a20cf84668a782d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:44Z,use_quota=True,user_id='b47d479926f64a50943db6a7af32c825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:17:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Creating volume 570d2307-184b-4e47-a4a0-91649f7e0d2f {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:17:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:17:52 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:17:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-570d2307-184b-4e47-a4a0-91649f7e0d2f 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:53 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-570d2307-184b-4e47-a4a0-91649f7e0d2f 1073741824 Jun 25 17:17:53 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b303485-e9d8-4ee6-8d1e-8aa3ec75f50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e79090e-8901-41bb-b4eb-9bf73c5357a3', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5a31b8-6ad5-4633-a0f4-65c0bd52dd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:53 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Volume volume-0e79090e-8901-41bb-b4eb-9bf73c5357a3 (0e79090e-8901-41bb-b4eb-9bf73c5357a3): created successfully Jun 25 17:17:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d5a31b8-6ad5-4633-a0f4-65c0bd52dd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Flow 'volume_create_manager' (cb19a83f-176b-4f5e-b6d8-e1936303c1f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:53 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-ca791984-43a7-4230-807f-7f3021e089a8 tempest-CreateVolumesFromImageTest-1944119671 None] Created volume successfully. Jun 25 17:17:53 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532" returned: 0 in 1.378s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:53 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532 Jun 25 17:17:53 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:54 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-570d2307-184b-4e47-a4a0-91649f7e0d2f 1073741824" returned: 0 in 1.286s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-570d2307-184b-4e47-a4a0-91649f7e0d2f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:54 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-570d2307-184b-4e47-a4a0-91649f7e0d2f Jun 25 17:17:54 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:54 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-63a56af2-02ab-4fbc-bbf3-33ad9c73f532" returned: 0 in 1.013s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:54 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Lock "cinder-quobyte-63a56af2-02ab-4fbc-bbf3-33ad9c73f532" released by "delete_volume" :: held 2.521s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:17:54 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Created reservations ['eb1ba655-b7df-492b-9af7-1a9f8d395e0a', '46d61e94-c2a3-43ae-94bf-498a9a7a43f8', 'f2ed2d48-6432-4cc6-9e6a-966aa92b6a30', 'b071f9b3-13e2-40d1-a8d3-0b29e0426ce1'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:17:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:54 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:17:54 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:55 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-570d2307-184b-4e47-a4a0-91649f7e0d2f" returned: 0 in 0.899s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:17:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.291s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.449s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1797022035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74ee81fc-54b3-4dfe-957b-a22da5feeaaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51cbb2beb8c4dc9a20cf84668a782d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:44Z,use_quota=True,user_id='b47d479926f64a50943db6a7af32c825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:17:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Creating volume 74ee81fc-54b3-4dfe-957b-a22da5feeaaf {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:17:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:17:55 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:17:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-74ee81fc-54b3-4dfe-957b-a22da5feeaaf 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:55 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-74ee81fc-54b3-4dfe-957b-a22da5feeaaf 1073741824 Jun 25 17:17:55 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa483dd5-9777-4645-a831-de16b499ac4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-570d2307-184b-4e47-a4a0-91649f7e0d2f', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4970d72-be73-4d89-bd0f-60fa4d755a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:55 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Volume volume-570d2307-184b-4e47-a4a0-91649f7e0d2f (570d2307-184b-4e47-a4a0-91649f7e0d2f): created successfully Jun 25 17:17:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4970d72-be73-4d89-bd0f-60fa4d755a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Flow 'volume_create_manager' (1e6c03fd-7a6a-4a20-a35d-dafb2dee0674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:55 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-a458db05-76fe-4ce8-a472-b85f6791095d tempest-CreateVolumesFromImageTest-1944119671 None] Created volume successfully. Jun 25 17:17:56 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.140s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:56 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:17:56 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Deleted volume successfully. Jun 25 17:17:56 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-856f3bff-2609-4d42-88ae-cb63a6bb7f6e tempest-VolumeSnapshotQuotasNegativeTestJSON-1963141823 None] Lock "cinder-63a56af2-02ab-4fbc-bbf3-33ad9c73f532-delete_volume" released by "delete_volume" :: held 3.998s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:17:56 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-74ee81fc-54b3-4dfe-957b-a22da5feeaaf 1073741824" returned: 0 in 1.371s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-74ee81fc-54b3-4dfe-957b-a22da5feeaaf {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:56 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-74ee81fc-54b3-4dfe-957b-a22da5feeaaf Jun 25 17:17:56 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:57 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-74ee81fc-54b3-4dfe-957b-a22da5feeaaf" returned: 0 in 1.209s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:57 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] <== create_volume: return (2692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:17:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.696s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.511s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:57 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:17:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1924540195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9636b2b-d467-4c55-ba3d-b51aae58279d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a51cbb2beb8c4dc9a20cf84668a782d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:17:45Z,use_quota=True,user_id='b47d479926f64a50943db6a7af32c825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:17:57 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Creating volume a9636b2b-d467-4c55-ba3d-b51aae58279d {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:17:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:17:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:17:57 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:17:57 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:17:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:17:57 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:17:57 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:17:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9636b2b-d467-4c55-ba3d-b51aae58279d 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:58 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3df9728-4f72-46c0-8d6c-b36ecbf29d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74ee81fc-54b3-4dfe-957b-a22da5feeaaf', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:58 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9636b2b-d467-4c55-ba3d-b51aae58279d 1073741824 Jun 25 17:17:58 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:17:58 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2b54c4-e5dc-4652-ae51-9624e55bfae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:17:58 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Volume volume-74ee81fc-54b3-4dfe-957b-a22da5feeaaf (74ee81fc-54b3-4dfe-957b-a22da5feeaaf): created successfully Jun 25 17:17:58 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2b54c4-e5dc-4652-ae51-9624e55bfae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:17:58 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Flow 'volume_create_manager' (09547704-ab7b-430c-b776-9fd64b1031d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:17:58 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-6fa33c61-a46a-465b-9fad-dc377b4b3a31 tempest-CreateVolumesFromImageTest-1944119671 None] Created volume successfully. Jun 25 17:17:59 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Jun 25 17:17:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9636b2b-d467-4c55-ba3d-b51aae58279d 1073741824" returned: 0 in 1.195s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:17:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9636b2b-d467-4c55-ba3d-b51aae58279d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:17:59 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9636b2b-d467-4c55-ba3d-b51aae58279d Jun 25 17:17:59 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:00 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9636b2b-d467-4c55-ba3d-b51aae58279d" returned: 0 in 0.803s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:00 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] <== create_volume: return (2053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:18:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e27af7dc-b4f6-4932-87d3-e32752e91855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9636b2b-d467-4c55-ba3d-b51aae58279d', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc25187-da27-496c-b1df-b4aabb7e13f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:00 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Volume volume-a9636b2b-d467-4c55-ba3d-b51aae58279d (a9636b2b-d467-4c55-ba3d-b51aae58279d): created successfully Jun 25 17:18:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc25187-da27-496c-b1df-b4aabb7e13f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Flow 'volume_create_manager' (99c5b06b-c1ae-462d-a14a-e706319fc80e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:18:00 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-82c2d94d-a683-4dc2-a558-53e3519d0d46 tempest-CreateVolumesFromImageTest-1944119671 None] Created volume successfully. Jun 25 17:18:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "cinder-a9636b2b-d467-4c55-ba3d-b51aae58279d-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-a9636b2b-d467-4c55-ba3d-b51aae58279d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "cinder-quobyte-a9636b2b-d467-4c55-ba3d-b51aae58279d" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-quobyte-a9636b2b-d467-4c55-ba3d-b51aae58279d" acquired by "delete_volume" :: waited 0.021s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:01 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d2c059-ec1f-4ed7-bf79-7f36be3198d0]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9636b2b-d467-4c55-ba3d-b51aae58279d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:01 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9636b2b-d467-4c55-ba3d-b51aae58279d Jun 25 17:18:01 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:02 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9636b2b-d467-4c55-ba3d-b51aae58279d" returned: 0 in 0.991s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9636b2b-d467-4c55-ba3d-b51aae58279d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:02 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9636b2b-d467-4c55-ba3d-b51aae58279d Jun 25 17:18:02 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:03 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a9636b2b-d467-4c55-ba3d-b51aae58279d" returned: 0 in 0.904s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-quobyte-a9636b2b-d467-4c55-ba3d-b51aae58279d" released by "delete_volume" :: held 1.958s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:03 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] Created reservations ['9ce0fe50-b69a-4a5f-aec4-ba674ad09ba8', 'd9a6f7b8-4a3f-40ef-b98d-dce6c486a73a', '496ab934-cb70-41d2-996d-b56d1b498b4c', 'ea4c87bd-88c0-49b1-b63a-85dbcdf9067c'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:18:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:03 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:18:03 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:18:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:03 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:18:03 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "cinder-74ee81fc-54b3-4dfe-957b-a22da5feeaaf-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-74ee81fc-54b3-4dfe-957b-a22da5feeaaf-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "cinder-quobyte-74ee81fc-54b3-4dfe-957b-a22da5feeaaf" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-quobyte-74ee81fc-54b3-4dfe-957b-a22da5feeaaf" acquired by "delete_volume" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:03 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a1fa6c-a22e-48a6-afb4-894bc22a10d9]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-74ee81fc-54b3-4dfe-957b-a22da5feeaaf {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:03 devstack sudo[107487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-74ee81fc-54b3-4dfe-957b-a22da5feeaaf Jun 25 17:18:03 devstack sudo[107487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:04 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.004s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:04 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:18:04 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] Deleted volume successfully. Jun 25 17:18:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-07dd0ead-231e-43d8-a550-202d03512951 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-a9636b2b-d467-4c55-ba3d-b51aae58279d-delete_volume" released by "delete_volume" :: held 3.365s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:04 devstack sudo[107487]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-74ee81fc-54b3-4dfe-957b-a22da5feeaaf" returned: 0 in 1.314s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-74ee81fc-54b3-4dfe-957b-a22da5feeaaf {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:05 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-74ee81fc-54b3-4dfe-957b-a22da5feeaaf Jun 25 17:18:05 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:06 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-74ee81fc-54b3-4dfe-957b-a22da5feeaaf" returned: 0 in 1.198s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-quobyte-74ee81fc-54b3-4dfe-957b-a22da5feeaaf" released by "delete_volume" :: held 2.622s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:06 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] Created reservations ['70ba38eb-7994-4592-80d7-1856daefc98e', '9fe2516b-00ea-456c-8c1e-fa7d305ef01e', '0d0037b3-280c-41cc-8b92-44d8a9855db5', 'fc273eeb-6cb8-4fb9-bd34-4b9a38ed564d'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:18:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:18:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:18:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:06 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:18:06 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "cinder-570d2307-184b-4e47-a4a0-91649f7e0d2f-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-570d2307-184b-4e47-a4a0-91649f7e0d2f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Flow 'volume_create_manager' (fe1c7eaf-9b24-45ed-b6ea-51a6cd7013b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f549cdbb-8b55-47dc-abb4-5dde4d2fc5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f549cdbb-8b55-47dc-abb4-5dde4d2fc5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1550100806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8148911-6295-4f93-a0a6-2f4e7978cddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134fc8305def4a8b8e870a32872ecd2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:18:07Z,use_quota=True,user_id='b149a0b7ea4949dba4edf6e2a7bdb351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc658d45-e0dd-4b55-9b1c-71c6a69979f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc658d45-e0dd-4b55-9b1c-71c6a69979f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ed1ffc-e0fa-493c-b78b-1eb3f38d39b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ed1ffc-e0fa-493c-b78b-1eb3f38d39b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8148911-6295-4f93-a0a6-2f4e7978cddb', 'volume_name': 'volume-d8148911-6295-4f93-a0a6-2f4e7978cddb', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0255bec-c547-4777-9bfd-6f6cba414a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0255bec-c547-4777-9bfd-6f6cba414a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92949ac-fb63-4d03-a9b7-d8f9b0e8ec34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:07 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Volume d8148911-6295-4f93-a0a6-2f4e7978cddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8148911-6295-4f93-a0a6-2f4e7978cddb', 'volume_size': 1} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:18:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1550100806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8148911-6295-4f93-a0a6-2f4e7978cddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134fc8305def4a8b8e870a32872ecd2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:18:07Z,use_quota=True,user_id='b149a0b7ea4949dba4edf6e2a7bdb351',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Creating volume d8148911-6295-4f93-a0a6-2f4e7978cddb {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:18:07 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:07 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb 1073741824 Jun 25 17:18:07 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "cinder-quobyte-570d2307-184b-4e47-a4a0-91649f7e0d2f" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-quobyte-570d2307-184b-4e47-a4a0-91649f7e0d2f" acquired by "delete_volume" :: waited 0.028s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec9bf26-77f9-46e7-9492-540b105a48db]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-570d2307-184b-4e47-a4a0-91649f7e0d2f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:07 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-570d2307-184b-4e47-a4a0-91649f7e0d2f Jun 25 17:18:07 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:07 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.322s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:07 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:18:08 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] Deleted volume successfully. Jun 25 17:18:08 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-607c36eb-2c7c-4205-94b5-a0f1e7cb63b1 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-74ee81fc-54b3-4dfe-957b-a22da5feeaaf-delete_volume" released by "delete_volume" :: held 4.615s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:08 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb 1073741824" returned: 0 in 1.600s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:08 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb Jun 25 17:18:08 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:09 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-570d2307-184b-4e47-a4a0-91649f7e0d2f" returned: 0 in 1.775s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-570d2307-184b-4e47-a4a0-91649f7e0d2f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:09 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-570d2307-184b-4e47-a4a0-91649f7e0d2f Jun 25 17:18:09 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:09 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb" returned: 0 in 0.855s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] <== create_volume: return (2510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:18:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.513s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92949ac-fb63-4d03-a9b7-d8f9b0e8ec34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8148911-6295-4f93-a0a6-2f4e7978cddb', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e58d6c8-5636-4f24-84ad-0d33a424a132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:09 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Volume volume-d8148911-6295-4f93-a0a6-2f4e7978cddb (d8148911-6295-4f93-a0a6-2f4e7978cddb): created successfully Jun 25 17:18:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e58d6c8-5636-4f24-84ad-0d33a424a132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Flow 'volume_create_manager' (fe1c7eaf-9b24-45ed-b6ea-51a6cd7013b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:18:09 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-915e8ba7-b84d-48ef-9445-ad04884ec1d3 tempest-SnapshotMetadataTestJSON-125734136 None] Created volume successfully. Jun 25 17:18:10 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-570d2307-184b-4e47-a4a0-91649f7e0d2f" returned: 0 in 0.861s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-quobyte-570d2307-184b-4e47-a4a0-91649f7e0d2f" released by "delete_volume" :: held 2.698s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:10 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] Created reservations ['8dc702e9-79c7-4643-aaf9-2ee32f8bfac4', 'e0557d03-90ec-40f7-b78c-8b6910c91842', '557efe69-e9a8-43db-95d7-9c950852e6c6', 'a11a8b55-a113-4b0f-a5fa-9b859d0bbcb6'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:18:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:18:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:18:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:10 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:18:10 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b0d79bdc-a772-4862-9d96-ac67262bc092 tempest-SnapshotMetadataTestJSON-125734136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b0d79bdc-a772-4862-9d96-ac67262bc092 tempest-SnapshotMetadataTestJSON-125734136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "cinder-0e79090e-8901-41bb-b4eb-9bf73c5357a3-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-b0d79bdc-a772-4862-9d96-ac67262bc092 tempest-SnapshotMetadataTestJSON-125734136 None] Creating offline snapshot 0202f73f-c26d-440c-b847-b26eeeec813b of volume d8148911-6295-4f93-a0a6-2f4e7978cddb {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:18:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-0e79090e-8901-41bb-b4eb-9bf73c5357a3-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:10 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[42625d7d-21c0-441e-a0a3-ea604a76a7f9]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b0d79bdc-a772-4862-9d96-ac67262bc092 tempest-SnapshotMetadataTestJSON-125734136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "cinder-quobyte-0e79090e-8901-41bb-b4eb-9bf73c5357a3" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-quobyte-0e79090e-8901-41bb-b4eb-9bf73c5357a3" acquired by "delete_volume" :: waited 0.034s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:11 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e06bbf-d0f6-4ceb-96f7-009613b61b32]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0e79090e-8901-41bb-b4eb-9bf73c5357a3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:11 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb Jun 25 17:18:11 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:11 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0e79090e-8901-41bb-b4eb-9bf73c5357a3 Jun 25 17:18:11 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:11 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.456s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:11 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:18:11 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] Deleted volume successfully. Jun 25 17:18:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5d175803-e26c-4472-9b65-cfb056efab0b tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-570d2307-184b-4e47-a4a0-91649f7e0d2f-delete_volume" released by "delete_volume" :: held 4.722s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-e0d8299b-cc3b-4c0f-a20d-a86f19c46c11 req-ed60b0ff-e94c-453b-b223-4b60a21eff5b tempest-TestStampPattern-1774809409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:12 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b0d79bdc-a772-4862-9d96-ac67262bc092 tempest-SnapshotMetadataTestJSON-125734136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb" returned: 0 in 1.657s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b0d79bdc-a772-4862-9d96-ac67262bc092 tempest-SnapshotMetadataTestJSON-125734136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:12 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b 1G Jun 25 17:18:12 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:12 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0e79090e-8901-41bb-b4eb-9bf73c5357a3" returned: 0 in 1.552s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0e79090e-8901-41bb-b4eb-9bf73c5357a3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:12 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0e79090e-8901-41bb-b4eb-9bf73c5357a3 Jun 25 17:18:12 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:13 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0e79090e-8901-41bb-b4eb-9bf73c5357a3" returned: 0 in 0.757s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-quobyte-0e79090e-8901-41bb-b4eb-9bf73c5357a3" released by "delete_volume" :: held 2.388s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:13 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] Created reservations ['523cb012-3638-4e52-8177-b94b676d8501', 'db531b28-fcae-4c29-8011-9ea4a4813d47', 'fa1fe48d-f173-4a4c-bb9e-781361471509', 'fed13d8b-570d-4437-a4e4-9342f571e851'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:18:13 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b0d79bdc-a772-4862-9d96-ac67262bc092 tempest-SnapshotMetadataTestJSON-125734136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b 1G" returned: 0 in 1.015s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b0d79bdc-a772-4862-9d96-ac67262bc092 tempest-SnapshotMetadataTestJSON-125734136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8148911-6295-4f93-a0a6-2f4e7978cddb -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:13 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8148911-6295-4f93-a0a6-2f4e7978cddb -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b Jun 25 17:18:13 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:13 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:18:13 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:18:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:13 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:18:13 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:14 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "cinder-b3244c80-4e4b-46e7-b5e5-13306048a8e1-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:14 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-b3244c80-4e4b-46e7-b5e5-13306048a8e1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:14 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "cinder-quobyte-b3244c80-4e4b-46e7-b5e5-13306048a8e1" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:14 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-quobyte-b3244c80-4e4b-46e7-b5e5-13306048a8e1" acquired by "delete_volume" :: waited 0.029s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:14 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ef0f49-c5c9-4ab9-9910-53be0e5e5815]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b3244c80-4e4b-46e7-b5e5-13306048a8e1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:14 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b0d79bdc-a772-4862-9d96-ac67262bc092 tempest-SnapshotMetadataTestJSON-125734136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8148911-6295-4f93-a0a6-2f4e7978cddb -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b" returned: 0 in 1.027s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:14 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-b0d79bdc-a772-4862-9d96-ac67262bc092 tempest-SnapshotMetadataTestJSON-125734136 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b is being set with open permissions: ugo+rw Jun 25 17:18:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b0d79bdc-a772-4862-9d96-ac67262bc092 tempest-SnapshotMetadataTestJSON-125734136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:14 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b Jun 25 17:18:14 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:14 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.957s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:14 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b3244c80-4e4b-46e7-b5e5-13306048a8e1 Jun 25 17:18:14 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:14 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:18:14 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] Deleted volume successfully. Jun 25 17:18:14 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-34cee55d-698a-4aa7-9f13-17467d2c0ad0 tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-0e79090e-8901-41bb-b4eb-9bf73c5357a3-delete_volume" released by "delete_volume" :: held 3.825s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:15 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b0d79bdc-a772-4862-9d96-ac67262bc092 tempest-SnapshotMetadataTestJSON-125734136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b" returned: 0 in 0.764s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b0d79bdc-a772-4862-9d96-ac67262bc092 tempest-SnapshotMetadataTestJSON-125734136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:15 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.info Jun 25 17:18:15 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:15 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b3244c80-4e4b-46e7-b5e5-13306048a8e1" returned: 0 in 0.939s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b3244c80-4e4b-46e7-b5e5-13306048a8e1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:15 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b3244c80-4e4b-46e7-b5e5-13306048a8e1 Jun 25 17:18:15 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:16 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b0d79bdc-a772-4862-9d96-ac67262bc092 tempest-SnapshotMetadataTestJSON-125734136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.info" returned: 0 in 0.781s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:16 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-b0d79bdc-a772-4862-9d96-ac67262bc092 tempest-SnapshotMetadataTestJSON-125734136 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.info is being set with open permissions: ugo+rw Jun 25 17:18:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b0d79bdc-a772-4862-9d96-ac67262bc092 tempest-SnapshotMetadataTestJSON-125734136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:16 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.info Jun 25 17:18:16 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:16 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b3244c80-4e4b-46e7-b5e5-13306048a8e1" returned: 0 in 0.798s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:16 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-quobyte-b3244c80-4e4b-46e7-b5e5-13306048a8e1" released by "delete_volume" :: held 1.811s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:16 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] Created reservations ['d2b0d758-c718-4b8c-8550-a2ab013313d5', '8155c115-3d0d-47a7-9fbc-08cd0ca942d8', '15ad3022-26f9-4dc2-bb81-39c1e91388da', '714afaf8-ca78-4819-809e-d4b005328706'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:18:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:18:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:18:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:16 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:18:16 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:17 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b0d79bdc-a772-4862-9d96-ac67262bc092 tempest-SnapshotMetadataTestJSON-125734136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.info" returned: 0 in 0.898s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b0d79bdc-a772-4862-9d96-ac67262bc092 tempest-SnapshotMetadataTestJSON-125734136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.350s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-e0d8299b-cc3b-4c0f-a20d-a86f19c46c11 req-ed60b0ff-e94c-453b-b223-4b60a21eff5b tempest-TestStampPattern-1774809409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.815s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:17 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb4dc37-0223-4d12-8160-ead248687562]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-e0d8299b-cc3b-4c0f-a20d-a86f19c46c11 req-ed60b0ff-e94c-453b-b223-4b60a21eff5b tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-34a950d2-d71c-483b-bb14-833002afc18e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:17 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b0d79bdc-a772-4862-9d96-ac67262bc092 tempest-SnapshotMetadataTestJSON-125734136 None] Create snapshot completed successfully Jun 25 17:18:17 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-34a950d2-d71c-483b-bb14-833002afc18e Jun 25 17:18:17 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:17 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.905s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:17 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:18:17 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] Deleted volume successfully. Jun 25 17:18:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-21af3319-b9fa-4a48-bea2-74740baad45b tempest-CreateVolumesFromImageTest-1944119671 None] Lock "cinder-b3244c80-4e4b-46e7-b5e5-13306048a8e1-delete_volume" released by "delete_volume" :: held 3.007s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:18 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-e0d8299b-cc3b-4c0f-a20d-a86f19c46c11 req-ed60b0ff-e94c-453b-b223-4b60a21eff5b tempest-TestStampPattern-1774809409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-34a950d2-d71c-483b-bb14-833002afc18e" returned: 0 in 1.178s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-e0d8299b-cc3b-4c0f-a20d-a86f19c46c11 req-ed60b0ff-e94c-453b-b223-4b60a21eff5b tempest-TestStampPattern-1774809409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.216s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:18 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-e0d8299b-cc3b-4c0f-a20d-a86f19c46c11 req-ed60b0ff-e94c-453b-b223-4b60a21eff5b tempest-TestStampPattern-1774809409 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-34a950d2-d71c-483b-bb14-833002afc18e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85ef20e1-0e55-4940-98c8-2303d2f21364', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:18:18 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-e0d8299b-cc3b-4c0f-a20d-a86f19c46c11 req-ed60b0ff-e94c-453b-b223-4b60a21eff5b tempest-TestStampPattern-1774809409 None] attachment_update completed successfully. Jun 25 17:18:19 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] Acquiring lock "cinder-0202f73f-c26d-440c-b847-b26eeeec813b-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:19 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] Lock "cinder-0202f73f-c26d-440c-b847-b26eeeec813b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:19 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] Acquiring lock "cinder-quobyte-d8148911-6295-4f93-a0a6-2f4e7978cddb" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:19 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] Lock "cinder-quobyte-d8148911-6295-4f93-a0a6-2f4e7978cddb" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:19 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] Acquiring lock "cinder-quobyte-0202f73f-c26d-440c-b847-b26eeeec813b" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:19 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] Lock "cinder-quobyte-0202f73f-c26d-440c-b847-b26eeeec813b" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:19 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] Deleting offline snapshot 0202f73f-c26d-440c-b847-b26eeeec813b of volume d8148911-6295-4f93-a0a6-2f4e7978cddb {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:18:19 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] snapshot_file for this snap is: volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:18:19 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[74756852-4714-480f-ac6d-eb5897864747]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:19 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b Jun 25 17:18:19 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:20 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b" returned: 0 in 1.115s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8148911-6295-4f93-a0a6-2f4e7978cddb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:18:20 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[11759ba6-8ef4-476b-a7c4-0fd02224ff49]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:20 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb Jun 25 17:18:20 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Flow 'volume_create_manager' (7e465430-6a2d-47a7-bd44-afb62c5a060b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882142c3-bad4-46fd-8521-e9b313ffa5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882142c3-bad4-46fd-8521-e9b313ffa5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1170938959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0658a2fb4b0a4f5fb482a9805d827f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:18:21Z,use_quota=True,user_id='08e52a97333047ee9e28d10cf747bd39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07072283-2063-499c-841d-1b65f917f31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07072283-2063-499c-841d-1b65f917f31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f0f5c6-b861-4220-8565-f27d3b7596ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f0f5c6-b861-4220-8565-f27d3b7596ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839', 'volume_name': 'volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c96e3f5-1e15-482b-aca5-e29336848c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c96e3f5-1e15-482b-aca5-e29336848c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd36ce4-944d-4d82-b236-d49033f58f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:21 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Volume 7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839', 'volume_size': 1} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1170938959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0658a2fb4b0a4f5fb482a9805d827f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:18:21Z,use_quota=True,user_id='08e52a97333047ee9e28d10cf747bd39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Creating volume 7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:18:21 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:21 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 1073741824 Jun 25 17:18:21 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:21 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb" returned: 0 in 1.063s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:21 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b Jun 25 17:18:21 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:22 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 1073741824" returned: 0 in 1.144s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:22 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 Jun 25 17:18:22 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:22 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b" returned: 0 in 1.013s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:22 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b Jun 25 17:18:22 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:23 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839" returned: 0 in 0.808s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:18:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:23 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd36ce4-944d-4d82-b236-d49033f58f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:23 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1edfcf08-4e40-4004-a082-7d5b8b85416d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:23 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Volume volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 (7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839): created successfully Jun 25 17:18:23 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1edfcf08-4e40-4004-a082-7d5b8b85416d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:23 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Flow 'volume_create_manager' (7e465430-6a2d-47a7-bd44-afb62c5a060b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:18:23 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-5d03dda8-b4d9-482c-aabf-80d9570c8fdb tempest-VolumeDependencyTests-482749322 None] Created volume successfully. Jun 25 17:18:23 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb.0202f73f-c26d-440c-b847-b26eeeec813b" returned: 0 in 0.842s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] Lock "cinder-quobyte-0202f73f-c26d-440c-b847-b26eeeec813b" released by "_delete_snapshot" :: held 4.169s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] Lock "cinder-quobyte-d8148911-6295-4f93-a0a6-2f4e7978cddb" released by "delete_snapshot" :: held 4.208s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:23 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] Created reservations ['5956e718-f5e9-4d26-95bf-dee9577694cb', '6d80600a-3f39-41a2-a971-42ea3d3569e8', '5ef4cfa4-f108-49fc-baa9-39c35e9f17c6', 'c0e7a7d1-11c6-480b-a08f-8e73128b8c60'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:18:23 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] Delete snapshot completed successfully. Jun 25 17:18:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dea16e1a-3e25-4071-858c-701f2876384e tempest-SnapshotMetadataTestJSON-125734136 None] Lock "cinder-0202f73f-c26d-440c-b847-b26eeeec813b-delete_snapshot" released by "delete_snapshot" :: held 4.453s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a05f8aee-0b03-4a2d-9a35-68d6e346fcb0 tempest-VolumeDependencyTests-482749322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a05f8aee-0b03-4a2d-9a35-68d6e346fcb0 tempest-VolumeDependencyTests-482749322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a05f8aee-0b03-4a2d-9a35-68d6e346fcb0 tempest-VolumeDependencyTests-482749322 None] Creating offline snapshot 10af3486-b6da-40e6-86e6-5da2040575d4 of volume 7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:18:24 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e51c22-f321-4f06-8a27-652ea7b48483]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a05f8aee-0b03-4a2d-9a35-68d6e346fcb0 tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] Acquiring lock "cinder-d8148911-6295-4f93-a0a6-2f4e7978cddb-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] Lock "cinder-d8148911-6295-4f93-a0a6-2f4e7978cddb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] Acquiring lock "cinder-quobyte-d8148911-6295-4f93-a0a6-2f4e7978cddb" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:24 devstack sudo[108152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 Jun 25 17:18:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] Lock "cinder-quobyte-d8148911-6295-4f93-a0a6-2f4e7978cddb" acquired by "delete_volume" :: waited 0.021s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:24 devstack sudo[108152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:25 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[31825481-fb32-40af-9d47-ab10fab9a04f]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:25 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb Jun 25 17:18:25 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:25 devstack sudo[108152]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a05f8aee-0b03-4a2d-9a35-68d6e346fcb0 tempest-VolumeDependencyTests-482749322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839" returned: 0 in 1.188s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a05f8aee-0b03-4a2d-9a35-68d6e346fcb0 tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:25 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4 1G Jun 25 17:18:25 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:26 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb" returned: 0 in 1.060s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:26 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb Jun 25 17:18:26 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] Acquiring lock "cinder-4a417423-3467-4f3c-a43c-8e19ea0d0911-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] Lock "cinder-4a417423-3467-4f3c-a43c-8e19ea0d0911-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] Acquiring lock "cinder-quobyte-4a417423-3467-4f3c-a43c-8e19ea0d0911" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] Lock "cinder-quobyte-4a417423-3467-4f3c-a43c-8e19ea0d0911" acquired by "delete_volume" :: waited 0.032s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:26 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3beae9e-9d72-45ef-a931-b8fa60126408]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4a417423-3467-4f3c-a43c-8e19ea0d0911 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:27 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-648abf93-25fe-47de-9ebe-f9f61bcf90f3 req-32ff5233-81e0-4ab9-87e3-f2ecf47712e7 tempest-TestStampPattern-1774809409 None] Terminate volume connection completed successfully. Jun 25 17:18:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-648abf93-25fe-47de-9ebe-f9f61bcf90f3 req-32ff5233-81e0-4ab9-87e3-f2ecf47712e7 tempest-TestStampPattern-1774809409 None] Deleting attachment 85ef20e1-0e55-4940-98c8-2303d2f21364. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:18:27 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4a417423-3467-4f3c-a43c-8e19ea0d0911 Jun 25 17:18:27 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:27 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a05f8aee-0b03-4a2d-9a35-68d6e346fcb0 tempest-VolumeDependencyTests-482749322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4 1G" returned: 0 in 1.188s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a05f8aee-0b03-4a2d-9a35-68d6e346fcb0 tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:27 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4 Jun 25 17:18:27 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:27 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d8148911-6295-4f93-a0a6-2f4e7978cddb" returned: 0 in 1.105s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:27 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] Lock "cinder-quobyte-d8148911-6295-4f93-a0a6-2f4e7978cddb" released by "delete_volume" :: held 2.273s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:27 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] Created reservations ['dfc15f26-a65e-4e63-ada5-240149794f44', '51010de0-ba9e-475f-8cb3-de3c28b8ed8f', '883518b2-397c-45ca-a7db-b718796614bd', '4ec207aa-3c56-41f0-af2e-8340e596ddf7'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:18:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:18:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:18:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:27 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:18:27 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:27 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4a417423-3467-4f3c-a43c-8e19ea0d0911" returned: 0 in 1.065s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4a417423-3467-4f3c-a43c-8e19ea0d0911 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:27 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4a417423-3467-4f3c-a43c-8e19ea0d0911 Jun 25 17:18:27 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:28 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a05f8aee-0b03-4a2d-9a35-68d6e346fcb0 tempest-VolumeDependencyTests-482749322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4" returned: 0 in 0.999s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:28 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-a05f8aee-0b03-4a2d-9a35-68d6e346fcb0 tempest-VolumeDependencyTests-482749322 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4 is being set with open permissions: ugo+rw Jun 25 17:18:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a05f8aee-0b03-4a2d-9a35-68d6e346fcb0 tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:28 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4 Jun 25 17:18:28 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:28 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.750s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:28 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:18:28 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] Deleted volume successfully. Jun 25 17:18:28 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-45ac2873-7068-4909-af11-9148555479d1 tempest-SnapshotMetadataTestJSON-125734136 None] Lock "cinder-d8148911-6295-4f93-a0a6-2f4e7978cddb-delete_volume" released by "delete_volume" :: held 3.364s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:28 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4a417423-3467-4f3c-a43c-8e19ea0d0911" returned: 0 in 0.843s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:28 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] Lock "cinder-quobyte-4a417423-3467-4f3c-a43c-8e19ea0d0911" released by "delete_volume" :: held 1.975s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:28 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] Created reservations ['e79c352b-87d7-4e0a-9f85-0ce1acdc59dd', 'aca28aeb-007c-4680-aacc-b9d313fe9a43', 'ff0e3197-e635-4cca-9c25-22474b09c445', '52557c49-8416-4f71-ba1f-e9d90b1953e1'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:18:28 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a05f8aee-0b03-4a2d-9a35-68d6e346fcb0 tempest-VolumeDependencyTests-482749322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4" returned: 0 in 0.819s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a05f8aee-0b03-4a2d-9a35-68d6e346fcb0 tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:29 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.info Jun 25 17:18:29 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:29 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:18:29 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:18:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:29 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:18:29 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:30 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a05f8aee-0b03-4a2d-9a35-68d6e346fcb0 tempest-VolumeDependencyTests-482749322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.info" returned: 0 in 1.143s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:30 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-a05f8aee-0b03-4a2d-9a35-68d6e346fcb0 tempest-VolumeDependencyTests-482749322 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.info is being set with open permissions: ugo+rw Jun 25 17:18:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a05f8aee-0b03-4a2d-9a35-68d6e346fcb0 tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:30 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.info Jun 25 17:18:30 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:30 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.267s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:30 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:18:30 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] Deleted volume successfully. Jun 25 17:18:30 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6db3c142-f2e5-464c-be2c-ff75e0174e8c tempest-VolumesNegativeTest-1836645998 None] Lock "cinder-4a417423-3467-4f3c-a43c-8e19ea0d0911-delete_volume" released by "delete_volume" :: held 3.676s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:31 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a05f8aee-0b03-4a2d-9a35-68d6e346fcb0 tempest-VolumeDependencyTests-482749322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.info" returned: 0 in 1.108s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a05f8aee-0b03-4a2d-9a35-68d6e346fcb0 tempest-VolumeDependencyTests-482749322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.633s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:31 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-a05f8aee-0b03-4a2d-9a35-68d6e346fcb0 tempest-VolumeDependencyTests-482749322 None] Create snapshot completed successfully Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Flow 'volume_create_manager' (ede7d762-48f0-4464-a260-16cc12b56962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f2422f-90a4-49a8-b2a7-f5b5ec6b06b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f2422f-90a4-49a8-b2a7-f5b5ec6b06b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1306419562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e54089f-213e-42ed-9823-a74f2732e51b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0658a2fb4b0a4f5fb482a9805d827f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=10af3486-b6da-40e6-86e6-5da2040575d4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:18:33Z,use_quota=True,user_id='08e52a97333047ee9e28d10cf747bd39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc67d3b5-bc05-4352-a623-54c470e6961f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc67d3b5-bc05-4352-a623-54c470e6961f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668919a0-80e7-4059-835b-2446d89d4317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (668919a0-80e7-4059-835b-2446d89d4317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6e54089f-213e-42ed-9823-a74f2732e51b', 'volume_name': 'volume-6e54089f-213e-42ed-9823-a74f2732e51b', 'volume_size': 1, 'snapshot_id': '10af3486-b6da-40e6-86e6-5da2040575d4'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6335e2f7-dcf6-4198-bedc-4a542d2ea4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6335e2f7-dcf6-4198-bedc-4a542d2ea4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04252a6-8f20-4049-942f-0391391906f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:33 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Volume 6e54089f-213e-42ed-9823-a74f2732e51b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6e54089f-213e-42ed-9823-a74f2732e51b', 'volume_size': 1, 'snapshot_id': '10af3486-b6da-40e6-86e6-5da2040575d4'} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Acquiring lock "cinder-quobyte-10af3486-b6da-40e6-86e6-5da2040575d4-6e54089f-213e-42ed-9823-a74f2732e51b" by "_create_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Lock "cinder-quobyte-10af3486-b6da-40e6-86e6-5da2040575d4-6e54089f-213e-42ed-9823-a74f2732e51b" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Creating volume 6e54089f-213e-42ed-9823-a74f2732e51b from snapshot 10af3486-b6da-40e6-86e6-5da2040575d4 {{(pid=93869) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Acquiring lock "cinder-quobyte-6e54089f-213e-42ed-9823-a74f2732e51b" by "_copy_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Lock "cinder-quobyte-6e54089f-213e-42ed-9823-a74f2732e51b" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] snapshot: 10af3486-b6da-40e6-86e6-5da2040575d4, volume: 6e54089f-213e-42ed-9823-a74f2732e51b, {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d72692-9de8-4608-9cfe-748508b771e5]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:33 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4 Jun 25 17:18:33 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:35 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4" returned: 0 in 1.266s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:35 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:18:35 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] will copy from snapshot at /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 17:18:35 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Creating direct copy from snapshot {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 17:18:35 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd1ac60-3629-4f04-8122-e8b78163eaba]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:35 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 Jun 25 17:18:35 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:36 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839" returned: 0 in 1.137s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:36 devstack cinder-volume[93869]: DEBUG cinder.utils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Path /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6e54089f-213e-42ed-9823-a74f2732e51b not found in is_blk_device check {{(pid=93869) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 17:18:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6e54089f-213e-42ed-9823-a74f2732e51b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:36 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6e54089f-213e-42ed-9823-a74f2732e51b Jun 25 17:18:36 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:38 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] Acquiring lock "cinder-34a950d2-d71c-483b-bb14-833002afc18e-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:38 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] Lock "cinder-34a950d2-d71c-483b-bb14-833002afc18e-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:38 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] Acquiring lock "cinder-quobyte-34a950d2-d71c-483b-bb14-833002afc18e" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:38 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] Lock "cinder-quobyte-34a950d2-d71c-483b-bb14-833002afc18e" acquired by "delete_volume" :: waited 0.065s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:38 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9b50b6-f938-44a1-b3cb-6b7f253d3c4e]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-34a950d2-d71c-483b-bb14-833002afc18e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:38 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:18:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Flow 'volume_create_manager' (a4ff2836-e6a7-4328-ae95-8184bd139a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:18:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d264d7e-cb7a-4c0e-b174-1d7fcff6b458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d264d7e-cb7a-4c0e-b174-1d7fcff6b458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-544446803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04db2f30-da9c-4e9b-bc7d-f5969d1eeee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e17e999664472e916640cf4b050d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:18:38Z,use_quota=True,user_id='516e258f2f984293af2543ead13a92e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216020b5-61ce-4149-a7d2-cf455f974dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216020b5-61ce-4149-a7d2-cf455f974dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00ab251-5583-4021-9281-0cf3f57c80c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00ab251-5583-4021-9281-0cf3f57c80c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04db2f30-da9c-4e9b-bc7d-f5969d1eeee2', 'volume_name': 'volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff46f916-011c-4960-ab57-bb9c456dc704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff46f916-011c-4960-ab57-bb9c456dc704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a10bf4-1b61-4d20-8426-ffd2556d38f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:38 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Volume 04db2f30-da9c-4e9b-bc7d-f5969d1eeee2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2', 'volume_size': 1} Jun 25 17:18:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:38 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-34a950d2-d71c-483b-bb14-833002afc18e Jun 25 17:18:38 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:40 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-34a950d2-d71c-483b-bb14-833002afc18e" returned: 0 in 1.731s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-34a950d2-d71c-483b-bb14-833002afc18e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:40 devstack sudo[108337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-34a950d2-d71c-483b-bb14-833002afc18e Jun 25 17:18:40 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:42 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-34a950d2-d71c-483b-bb14-833002afc18e" returned: 0 in 2.204s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:42 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] Lock "cinder-quobyte-34a950d2-d71c-483b-bb14-833002afc18e" released by "delete_volume" :: held 4.116s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:42 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] Created reservations ['baf34614-86df-4e78-ae66-8211397e662e', '3608c897-a35f-4d9d-8350-6e837b8a9d01', '68b71033-6378-4fcd-b94d-81ef2a3c2639', 'f0c3bbdd-3c17-4d79-a34e-fdbfabe350ae'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:18:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:18:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:18:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:43 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:18:43 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:43 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6e54089f-213e-42ed-9823-a74f2732e51b" returned: 0 in 7.229s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:43 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3829b741-a11e-4418-bfb9-86ea0105a261]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:43 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 Jun 25 17:18:43 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:43 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] Acquiring lock "cinder-3c62af85-76aa-499a-b4b1-d2af9b4b9782-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:43 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] Lock "cinder-3c62af85-76aa-499a-b4b1-d2af9b4b9782-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:43 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] Acquiring lock "cinder-quobyte-596b3594-2fa6-4d27-9dd4-14c6bc466de5" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:43 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] Lock "cinder-quobyte-596b3594-2fa6-4d27-9dd4-14c6bc466de5" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:43 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] Acquiring lock "cinder-quobyte-3c62af85-76aa-499a-b4b1-d2af9b4b9782" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:43 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] Lock "cinder-quobyte-3c62af85-76aa-499a-b4b1-d2af9b4b9782" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] Deleting offline snapshot 3c62af85-76aa-499a-b4b1-d2af9b4b9782 of volume 596b3594-2fa6-4d27-9dd4-14c6bc466de5 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:18:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] snapshot_file for this snap is: volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:18:43 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2ae29d-7ac0-4d57-9682-e5ee3f638779]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:44 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:44 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782 Jun 25 17:18:44 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.083s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:44 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:18:44 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] Deleted volume successfully. Jun 25 17:18:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1a6cc9a7-c84c-4ae5-beba-b2905d044bcc tempest-TestStampPattern-1774809409 None] Lock "cinder-34a950d2-d71c-483b-bb14-833002afc18e-delete_volume" released by "delete_volume" :: held 5.960s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:18:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:18:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:18:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:44 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:18:44 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:45 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839" returned: 0 in 1.563s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Image conversion details: src /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839, size 1024.00 MB, duration 7.23 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6e54089f-213e-42ed-9823-a74f2732e51b {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:18:45 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Converted 1024.00 MB image at 141.60 MB/s Jun 25 17:18:45 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6e54089f-213e-42ed-9823-a74f2732e51b is being set with open permissions: ugo+rw Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6e54089f-213e-42ed-9823-a74f2732e51b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:45 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6e54089f-213e-42ed-9823-a74f2732e51b Jun 25 17:18:45 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:45 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782" returned: 0 in 1.251s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54c1c1d-3958-4d4f-bd80-a430ad362dac]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:45 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.119s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 28 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:18:45 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 Jun 25 17:18:45 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:45 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6e54089f-213e-42ed-9823-a74f2732e51b" returned: 0 in 0.926s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Lock "cinder-quobyte-6e54089f-213e-42ed-9823-a74f2732e51b" released by "_copy_volume_from_snapshot" :: held 12.284s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Lock "cinder-quobyte-10af3486-b6da-40e6-86e6-5da2040575d4-6e54089f-213e-42ed-9823-a74f2732e51b" released by "_create_volume_from_snapshot" :: held 12.337s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.361s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.048s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:18:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-544446803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04db2f30-da9c-4e9b-bc7d-f5969d1eeee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e17e999664472e916640cf4b050d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:18:38Z,use_quota=True,user_id='516e258f2f984293af2543ead13a92e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Creating volume 04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:18:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:18:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:18:46 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:18:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:46 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:DELETE=14,cinder:SELECT=78,cinder:UPDATE=111,cinder:INSERT=29 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:18:46 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=89,cinder:UPDATE=110,cinder:INSERT=25,cinder:DELETE=6 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:18:46 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 1073741824 Jun 25 17:18:46 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04252a6-8f20-4049-942f-0391391906f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e54089f-213e-42ed-9823-a74f2732e51b', 'volume_size': 1, 'snapshot_id': '10af3486-b6da-40e6-86e6-5da2040575d4'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f3ec16-f9d2-4bee-8eae-ab8a63d977b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:46 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Volume volume-6e54089f-213e-42ed-9823-a74f2732e51b (6e54089f-213e-42ed-9823-a74f2732e51b): created successfully Jun 25 17:18:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f3ec16-f9d2-4bee-8eae-ab8a63d977b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Flow 'volume_create_manager' (ede7d762-48f0-4464-a260-16cc12b56962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:18:46 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-c9df15ab-98a7-4673-9de1-8306dcab4f8e tempest-VolumeDependencyTests-482749322 None] Created volume successfully. Jun 25 17:18:46 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5" returned: 0 in 1.152s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:46 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782 Jun 25 17:18:46 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:47 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] Acquiring lock "cinder-10af3486-b6da-40e6-86e6-5da2040575d4-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:47 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] Lock "cinder-10af3486-b6da-40e6-86e6-5da2040575d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:47 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] Acquiring lock "cinder-quobyte-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:47 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] Lock "cinder-quobyte-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:47 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] Acquiring lock "cinder-quobyte-10af3486-b6da-40e6-86e6-5da2040575d4" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:47 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] Lock "cinder-quobyte-10af3486-b6da-40e6-86e6-5da2040575d4" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] Deleting offline snapshot 10af3486-b6da-40e6-86e6-5da2040575d4 of volume 7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:18:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] snapshot_file for this snap is: volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:18:47 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[395844aa-4b79-46c6-8799-67f9fdc4e32e]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:47 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4 Jun 25 17:18:47 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:47 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782" returned: 0 in 1.110s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:47 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782 Jun 25 17:18:47 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:47 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 1073741824" returned: 0 in 1.745s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:47 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 Jun 25 17:18:47 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:48 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4" returned: 0 in 1.626s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:18:48 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5.3c62af85-76aa-499a-b4b1-d2af9b4b9782" returned: 0 in 1.421s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:48 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0553e296-0c90-4f58-99fd-27456cf70dc7]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:49 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2" returned: 0 in 1.203s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:49 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] <== create_volume: return (3038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:18:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.043s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:49 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] Lock "cinder-quobyte-3c62af85-76aa-499a-b4b1-d2af9b4b9782" released by "_delete_snapshot" :: held 5.180s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:49 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] Lock "cinder-quobyte-596b3594-2fa6-4d27-9dd4-14c6bc466de5" released by "delete_snapshot" :: held 5.230s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16a10bf4-1b61-4d20-8426-ffd2556d38f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc9eb6a-8d4b-4393-9b55-db9f8cc5edf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:18:49 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Volume volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 (04db2f30-da9c-4e9b-bc7d-f5969d1eeee2): created successfully Jun 25 17:18:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc9eb6a-8d4b-4393-9b55-db9f8cc5edf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:18:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Flow 'volume_create_manager' (a4ff2836-e6a7-4328-ae95-8184bd139a39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:18:49 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 Jun 25 17:18:49 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:49 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-4c7bfafe-3a99-4546-9376-d6a4ef55c074 tempest-VolumesDeleteCascade-1237155825 None] Created volume successfully. Jun 25 17:18:49 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] Created reservations ['65a92563-0723-4bc7-94c7-93185e68ff23', 'f831eb21-da73-4f1a-9f58-8d8d2170996c', '1486bd5c-dac9-4ac6-86dc-214345183f01', '6ff7f092-f1a4-4557-9b46-805d1c271e71'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:18:49 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] Delete snapshot completed successfully. Jun 25 17:18:49 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-43adf7c9-9d00-4c37-b1e2-da80eda954a0 tempest-TestStampPattern-1774809409 None] Lock "cinder-3c62af85-76aa-499a-b4b1-d2af9b4b9782-delete_snapshot" released by "delete_snapshot" :: held 5.541s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:50 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839" returned: 0 in 1.389s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:50 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4 Jun 25 17:18:50 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4411711d-d69d-4e20-988c-3d9b97e76536 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4411711d-d69d-4e20-988c-3d9b97e76536 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-4411711d-d69d-4e20-988c-3d9b97e76536 tempest-VolumesDeleteCascade-1237155825 None] Creating offline snapshot 92421186-573b-4bf8-b5bd-cfa10a7e1217 of volume 04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:18:50 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c630c27f-55cc-451d-bc9d-b3381669b3e6]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4411711d-d69d-4e20-988c-3d9b97e76536 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:50 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 Jun 25 17:18:50 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:51 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4" returned: 0 in 1.301s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:51 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4411711d-d69d-4e20-988c-3d9b97e76536 tempest-VolumesDeleteCascade-1237155825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2" returned: 0 in 1.090s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4411711d-d69d-4e20-988c-3d9b97e76536 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:51 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4 Jun 25 17:18:51 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:51 devstack sudo[108404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 1G Jun 25 17:18:51 devstack sudo[108404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:52 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839.10af3486-b6da-40e6-86e6-5da2040575d4" returned: 0 in 1.251s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] Lock "cinder-quobyte-10af3486-b6da-40e6-86e6-5da2040575d4" released by "_delete_snapshot" :: held 5.768s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] Lock "cinder-quobyte-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839" released by "delete_snapshot" :: held 5.822s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:53 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] Created reservations ['7f8bd5e2-47f9-4a34-b475-684b8c5c84b6', '19d73c21-5a7d-42d9-b7f2-86483ac9288b', 'eed0b19c-68e5-4c61-a5fd-9df3ad5488f3', 'e96b4df1-ce93-4319-bbd5-7d9c368559d2'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:18:53 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] Delete snapshot completed successfully. Jun 25 17:18:53 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9b93fb88-c71d-47a4-8c47-454548a8638e tempest-VolumeDependencyTests-482749322 None] Lock "cinder-10af3486-b6da-40e6-86e6-5da2040575d4-delete_snapshot" released by "delete_snapshot" :: held 6.108s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:53 devstack sudo[108404]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4411711d-d69d-4e20-988c-3d9b97e76536 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 1G" returned: 0 in 1.677s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4411711d-d69d-4e20-988c-3d9b97e76536 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:53 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 Jun 25 17:18:53 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:53 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] Acquiring lock "cinder-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:53 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] Lock "cinder-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:53 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] Acquiring lock "cinder-quobyte-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:53 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] Lock "cinder-quobyte-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839" acquired by "delete_volume" :: waited 0.018s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:54 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f0f43b-7138-490d-a83c-91c4173bca0c]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:54 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 Jun 25 17:18:54 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:54 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4411711d-d69d-4e20-988c-3d9b97e76536 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217" returned: 0 in 1.485s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:54 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-4411711d-d69d-4e20-988c-3d9b97e76536 tempest-VolumesDeleteCascade-1237155825 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 is being set with open permissions: ugo+rw Jun 25 17:18:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4411711d-d69d-4e20-988c-3d9b97e76536 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:54 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 Jun 25 17:18:54 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:55 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839" returned: 0 in 1.515s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:55 devstack sudo[108480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839 Jun 25 17:18:55 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:55 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4411711d-d69d-4e20-988c-3d9b97e76536 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217" returned: 0 in 1.054s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4411711d-d69d-4e20-988c-3d9b97e76536 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:56 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.info Jun 25 17:18:56 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:56 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839" returned: 0 in 1.053s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:56 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] Lock "cinder-quobyte-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839" released by "delete_volume" :: held 2.655s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:56 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] Created reservations ['0c6862ab-9b84-4243-91ab-ab9bc8acdeff', '5d147e5b-aee3-44b3-a80e-06902d751a79', 'ba598959-f8fa-4413-bc89-ffa65aa9b604', '799039c4-df2e-413e-8f80-f2bf8c925a59'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:18:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:18:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:18:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:57 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:18:57 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:57 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4411711d-d69d-4e20-988c-3d9b97e76536 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.info" returned: 0 in 1.365s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:57 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-4411711d-d69d-4e20-988c-3d9b97e76536 tempest-VolumesDeleteCascade-1237155825 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.info is being set with open permissions: ugo+rw Jun 25 17:18:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4411711d-d69d-4e20-988c-3d9b97e76536 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:57 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.info Jun 25 17:18:57 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] Acquiring lock "cinder-6e54089f-213e-42ed-9823-a74f2732e51b-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] Lock "cinder-6e54089f-213e-42ed-9823-a74f2732e51b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] Acquiring lock "cinder-quobyte-6e54089f-213e-42ed-9823-a74f2732e51b" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:18:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] Lock "cinder-quobyte-6e54089f-213e-42ed-9823-a74f2732e51b" acquired by "delete_volume" :: waited 0.024s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:18:57 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eed35d3-115f-4e16-baa3-0a0c76d8d45f]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6e54089f-213e-42ed-9823-a74f2732e51b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:57 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6e54089f-213e-42ed-9823-a74f2732e51b Jun 25 17:18:57 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:58 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.238s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:58 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:18:58 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] Deleted volume successfully. Jun 25 17:18:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-44d14cc7-5634-4401-a590-c08da7bcb6ad tempest-VolumeDependencyTests-482749322 None] Lock "cinder-7aa5ef6d-2ee1-43fa-9bf9-bc2d1f633839-delete_volume" released by "delete_volume" :: held 4.363s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:18:58 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4411711d-d69d-4e20-988c-3d9b97e76536 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.info" returned: 0 in 1.090s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4411711d-d69d-4e20-988c-3d9b97e76536 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.988s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:18:58 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-4411711d-d69d-4e20-988c-3d9b97e76536 tempest-VolumesDeleteCascade-1237155825 None] Create snapshot completed successfully Jun 25 17:18:59 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Jun 25 17:18:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6e54089f-213e-42ed-9823-a74f2732e51b" returned: 0 in 1.404s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:18:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6e54089f-213e-42ed-9823-a74f2732e51b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:59 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6e54089f-213e-42ed-9823-a74f2732e51b Jun 25 17:18:59 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:18:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-801f6915-0aa5-4823-8843-fd35ebf78464 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:18:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-801f6915-0aa5-4823-8843-fd35ebf78464 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:18:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-801f6915-0aa5-4823-8843-fd35ebf78464 tempest-VolumesDeleteCascade-1237155825 None] Creating offline snapshot 6f967159-0790-45ba-8163-2dd4a9e78a9e of volume 04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:18:59 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ac3562-bb4f-489e-a0f8-f5af82884f48]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:18:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-801f6915-0aa5-4823-8843-fd35ebf78464 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:18:59 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 Jun 25 17:18:59 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:00 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6e54089f-213e-42ed-9823-a74f2732e51b" returned: 0 in 1.047s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:00 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] Lock "cinder-quobyte-6e54089f-213e-42ed-9823-a74f2732e51b" released by "delete_volume" :: held 2.528s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:00 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] Created reservations ['48151b09-bb01-40eb-b2ad-13e895b471e1', '62c23b2a-62c0-4618-8353-ce10a08bc25e', '0afd35b4-c08d-4a92-85d5-d26e68819db7', '230f0cc2-d0a3-4d17-b70d-92fa97e62e92'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:19:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:00 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:00 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:00 devstack sudo[108512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:19:00 devstack sudo[108512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:00 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-801f6915-0aa5-4823-8843-fd35ebf78464 tempest-VolumesDeleteCascade-1237155825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217" returned: 0 in 1.199s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:00 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-801f6915-0aa5-4823-8843-fd35ebf78464 tempest-VolumesDeleteCascade-1237155825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:19:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-801f6915-0aa5-4823-8843-fd35ebf78464 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:00 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e 1G Jun 25 17:19:00 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] Acquiring lock "cinder-596b3594-2fa6-4d27-9dd4-14c6bc466de5-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:00 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:00 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] Lock "cinder-596b3594-2fa6-4d27-9dd4-14c6bc466de5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] Acquiring lock "cinder-quobyte-596b3594-2fa6-4d27-9dd4-14c6bc466de5" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] Lock "cinder-quobyte-596b3594-2fa6-4d27-9dd4-14c6bc466de5" acquired by "delete_volume" :: waited 0.028s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:01 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f23183-27f4-49ed-89d2-e8b12ea0dcc8]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:19:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:01 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 Jun 25 17:19:01 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:01 devstack sudo[108512]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.108s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:01 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:19:01 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] Deleted volume successfully. Jun 25 17:19:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c97cfc6b-a288-4944-aba5-f0ba2bfc2471 tempest-VolumeDependencyTests-482749322 None] Lock "cinder-6e54089f-213e-42ed-9823-a74f2732e51b-delete_volume" released by "delete_volume" :: held 4.099s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:02 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-801f6915-0aa5-4823-8843-fd35ebf78464 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e 1G" returned: 0 in 1.610s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-801f6915-0aa5-4823-8843-fd35ebf78464 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:02 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e Jun 25 17:19:02 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:02 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5" returned: 0 in 1.519s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:02 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5 Jun 25 17:19:02 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:03 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-596b3594-2fa6-4d27-9dd4-14c6bc466de5" returned: 0 in 0.893s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] Lock "cinder-quobyte-596b3594-2fa6-4d27-9dd4-14c6bc466de5" released by "delete_volume" :: held 2.529s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:03 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] Created reservations ['26f9b7a1-db13-4a68-9fe0-1423a7ce1be2', 'aee56a47-6454-442b-99a2-a6fc7a8c8997', '3fea0169-425a-4e2e-b43b-ef33d973ec09', 'b3d70ef4-780e-4f72-ba1d-5192ade3ae73'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:19:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:03 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:03 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:03 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-801f6915-0aa5-4823-8843-fd35ebf78464 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e" returned: 0 in 1.387s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:03 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-801f6915-0aa5-4823-8843-fd35ebf78464 tempest-VolumesDeleteCascade-1237155825 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e is being set with open permissions: ugo+rw Jun 25 17:19:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-801f6915-0aa5-4823-8843-fd35ebf78464 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:03 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:19:03 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:03 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e Jun 25 17:19:03 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:05 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.292s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:05 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:19:05 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] Deleted volume successfully. Jun 25 17:19:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-90cda90c-2470-46b3-b964-3392cad5fe81 tempest-TestStampPattern-1774809409 None] Lock "cinder-596b3594-2fa6-4d27-9dd4-14c6bc466de5-delete_volume" released by "delete_volume" :: held 4.209s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:05 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-801f6915-0aa5-4823-8843-fd35ebf78464 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e" returned: 0 in 1.406s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-801f6915-0aa5-4823-8843-fd35ebf78464 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.785s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:05 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-801f6915-0aa5-4823-8843-fd35ebf78464 tempest-VolumesDeleteCascade-1237155825 None] Create snapshot completed successfully Jun 25 17:19:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "cinder-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Performing cascade delete. {{(pid=93869) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 25 17:19:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "cinder-6f967159-0790-45ba-8163-2dd4a9e78a9e-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-6f967159-0790-45ba-8163-2dd4a9e78a9e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "cinder-quobyte-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "cinder-quobyte-6f967159-0790-45ba-8163-2dd4a9e78a9e" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-6f967159-0790-45ba-8163-2dd4a9e78a9e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Deleting offline snapshot 6f967159-0790-45ba-8163-2dd4a9e78a9e of volume 04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:19:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] snapshot_file for this snap is: volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:19:06 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b33159-f1b3-474e-bcb4-e293ef88ef9a]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:19:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:06 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e Jun 25 17:19:06 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e" returned: 0 in 1.312s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:19:07 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd64b4e7-9461-42fe-a5d3-e2247ec55d83]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Flow 'volume_create_manager' (1e767534-d1bb-46aa-80c8-f7f328458797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b71c8e1b-0111-47a1-bc05-ab1e424b538e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b71c8e1b-0111-47a1-bc05-ab1e424b538e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542c5fb9-e435-4312-b29e-5d0df12c376a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff522ddd0064205b558dbae1c2102a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:08Z,use_quota=True,user_id='9e98d570514547c2bee6c7f42b118ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77f51ae-3447-4eea-97e8-8a191ac70b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77f51ae-3447-4eea-97e8-8a191ac70b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:07 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 Jun 25 17:19:07 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfbc9c5c-7d52-48e9-85c3-c3068d2b7bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfbc9c5c-7d52-48e9-85c3-c3068d2b7bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '542c5fb9-e435-4312-b29e-5d0df12c376a', 'volume_name': 'volume-542c5fb9-e435-4312-b29e-5d0df12c376a', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce194024-176e-476c-bebf-4c86a177c857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce194024-176e-476c-bebf-4c86a177c857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbbffdc5-4e37-4200-972b-7f7af9a583f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:07 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Volume 542c5fb9-e435-4312-b29e-5d0df12c376a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-542c5fb9-e435-4312-b29e-5d0df12c376a', 'volume_size': 1} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542c5fb9-e435-4312-b29e-5d0df12c376a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff522ddd0064205b558dbae1c2102a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:08Z,use_quota=True,user_id='9e98d570514547c2bee6c7f42b118ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Creating volume 542c5fb9-e435-4312-b29e-5d0df12c376a {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:19:07 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:19:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-542c5fb9-e435-4312-b29e-5d0df12c376a 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:08 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-542c5fb9-e435-4312-b29e-5d0df12c376a 1073741824 Jun 25 17:19:08 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:08 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217" returned: 0 in 1.258s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:08 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:19:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:09 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e Jun 25 17:19:09 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:09 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-542c5fb9-e435-4312-b29e-5d0df12c376a 1073741824" returned: 0 in 1.292s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-542c5fb9-e435-4312-b29e-5d0df12c376a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:09 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-542c5fb9-e435-4312-b29e-5d0df12c376a Jun 25 17:19:09 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:10 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e" returned: 0 in 1.387s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:10 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e Jun 25 17:19:10 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:10 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-542c5fb9-e435-4312-b29e-5d0df12c376a" returned: 0 in 1.224s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] <== create_volume: return (2634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:19:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.638s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbbffdc5-4e37-4200-972b-7f7af9a583f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-542c5fb9-e435-4312-b29e-5d0df12c376a', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbaefeba-93ad-4e6a-b7b3-0f111a7d1a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:10 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Volume volume-542c5fb9-e435-4312-b29e-5d0df12c376a (542c5fb9-e435-4312-b29e-5d0df12c376a): created successfully Jun 25 17:19:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbaefeba-93ad-4e6a-b7b3-0f111a7d1a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:10 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Flow 'volume_create_manager' (1e767534-d1bb-46aa-80c8-f7f328458797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:10 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-97642c28-f19d-439a-9bd0-0c040e9e7d13 tempest-CinderUnicodeTest-352015495 None] Created volume successfully. Jun 25 17:19:11 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.6f967159-0790-45ba-8163-2dd4a9e78a9e" returned: 0 in 0.925s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-6f967159-0790-45ba-8163-2dd4a9e78a9e" released by "_delete_snapshot" :: held 5.072s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2" released by "delete_snapshot" :: held 5.115s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:11 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Created reservations ['cd5e9ea0-3d43-4800-9698-43f0fdeab911', '6d32beda-b65d-4e32-95ea-5729ca53b555', '544da2c5-7362-469e-a7a5-3f1015b44da8', '10c4ded5-8519-4dd9-a1ad-29689eb830eb'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:19:11 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Delete snapshot completed successfully. Jun 25 17:19:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-6f967159-0790-45ba-8163-2dd4a9e78a9e-delete_snapshot" released by "delete_snapshot" :: held 5.429s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "cinder-92421186-573b-4bf8-b5bd-cfa10a7e1217-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-92421186-573b-4bf8-b5bd-cfa10a7e1217-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "cinder-quobyte-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "cinder-quobyte-92421186-573b-4bf8-b5bd-cfa10a7e1217" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-92421186-573b-4bf8-b5bd-cfa10a7e1217" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:11 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Deleting offline snapshot 92421186-573b-4bf8-b5bd-cfa10a7e1217 of volume 04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:19:11 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] snapshot_file for this snap is: volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:19:11 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5566dd-109f-4d40-b5c6-f8293c69dd81]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:19:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:11 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 Jun 25 17:19:11 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Flow 'volume_create_manager' (3c775f8d-99e5-42ba-9cdd-45bb88556ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50af122-6311-4f74-abb2-b28044866646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b50af122-6311-4f74-abb2-b28044866646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-892492637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79265fc0-ccb0-4d39-bad3-84ff09ca5392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff522ddd0064205b558dbae1c2102a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:12Z,use_quota=True,user_id='9e98d570514547c2bee6c7f42b118ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6706d00b-6f16-421a-abf4-0deea38ccb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6706d00b-6f16-421a-abf4-0deea38ccb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af707059-1c0c-402e-91eb-3d9677470334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af707059-1c0c-402e-91eb-3d9677470334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79265fc0-ccb0-4d39-bad3-84ff09ca5392', 'volume_name': 'volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ded562-9b7a-4b50-ba5a-c2e3c43fcbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ded562-9b7a-4b50-ba5a-c2e3c43fcbfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa10f9e2-a9a4-41f9-9869-eeb961b97b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:12 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Volume 79265fc0-ccb0-4d39-bad3-84ff09ca5392: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392', 'volume_size': 1} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:12Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-892492637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79265fc0-ccb0-4d39-bad3-84ff09ca5392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff522ddd0064205b558dbae1c2102a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:12Z,use_quota=True,user_id='9e98d570514547c2bee6c7f42b118ad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Creating volume 79265fc0-ccb0-4d39-bad3-84ff09ca5392 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:19:12 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:19:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:12 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392 1073741824 Jun 25 17:19:12 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:13 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217" returned: 0 in 1.403s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:13 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:19:13 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0effdcba-2a1c-4f7d-93a4-e1080c68f2dd]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:19:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:13 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 Jun 25 17:19:13 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:14 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392 1073741824" returned: 0 in 1.628s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:14 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392 Jun 25 17:19:14 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:14 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2" returned: 0 in 1.323s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:14 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 Jun 25 17:19:14 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:15 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392" returned: 0 in 0.880s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] <== create_volume: return (2585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:19:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.589s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa10f9e2-a9a4-41f9-9869-eeb961b97b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57959a4-a84b-4a72-ad3b-329e9b0e8ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:15 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Volume volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392 (79265fc0-ccb0-4d39-bad3-84ff09ca5392): created successfully Jun 25 17:19:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57959a4-a84b-4a72-ad3b-329e9b0e8ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Flow 'volume_create_manager' (3c775f8d-99e5-42ba-9cdd-45bb88556ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:15 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-ffc75dc9-27b2-4c72-a1ca-4f0d65388d1e tempest-CinderUnicodeTest-352015495 None] Created volume successfully. Jun 25 17:19:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-322ff4e9-2443-43c2-b869-9c1b2e3221fb tempest-CinderUnicodeTest-352015495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-322ff4e9-2443-43c2-b869-9c1b2e3221fb tempest-CinderUnicodeTest-352015495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-322ff4e9-2443-43c2-b869-9c1b2e3221fb tempest-CinderUnicodeTest-352015495 None] Creating offline snapshot 41da4e7b-509d-44e0-ade1-80b4bf3592e9 of volume 79265fc0-ccb0-4d39-bad3-84ff09ca5392 {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:19:15 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217" returned: 0 in 1.378s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:15 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d435c8af-ab5a-4e71-b436-d85f9cdb630b]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:19:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-322ff4e9-2443-43c2-b869-9c1b2e3221fb tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:15 devstack sudo[108602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217 Jun 25 17:19:16 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:16 devstack sudo[108603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392 Jun 25 17:19:16 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:17 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-322ff4e9-2443-43c2-b869-9c1b2e3221fb tempest-CinderUnicodeTest-352015495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392" returned: 0 in 1.099s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-322ff4e9-2443-43c2-b869-9c1b2e3221fb tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:17 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9 1G Jun 25 17:19:17 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:17 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2.92421186-573b-4bf8-b5bd-cfa10a7e1217" returned: 0 in 1.189s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-92421186-573b-4bf8-b5bd-cfa10a7e1217" released by "_delete_snapshot" :: held 5.450s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2" released by "delete_snapshot" :: held 5.486s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:17 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Created reservations ['f765e068-dea7-4163-8741-815b77ef7f98', 'f791e870-fdb9-47cc-a687-83a62d0c2616', '5fdf4dc3-863a-409c-83b3-075a19e2df69', '934e2534-07a6-439a-94ea-11481af8fb91'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:19:17 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Delete snapshot completed successfully. Jun 25 17:19:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-92421186-573b-4bf8-b5bd-cfa10a7e1217-delete_snapshot" released by "delete_snapshot" :: held 5.775s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Snapshots deleted, issuing volume delete {{(pid=93869) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 25 17:19:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "cinder-quobyte-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2" acquired by "delete_volume" :: waited 0.021s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:17 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[268f49be-74bd-4bc5-a381-0503bab675bd]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:19:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:17 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 Jun 25 17:19:17 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:18 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-322ff4e9-2443-43c2-b869-9c1b2e3221fb tempest-CinderUnicodeTest-352015495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9 1G" returned: 0 in 1.245s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-322ff4e9-2443-43c2-b869-9c1b2e3221fb tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:18 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9 Jun 25 17:19:18 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:18 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2" returned: 0 in 1.058s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:18 devstack sudo[108629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2 Jun 25 17:19:18 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:19 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-322ff4e9-2443-43c2-b869-9c1b2e3221fb tempest-CinderUnicodeTest-352015495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9" returned: 0 in 1.095s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:19 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-322ff4e9-2443-43c2-b869-9c1b2e3221fb tempest-CinderUnicodeTest-352015495 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9 is being set with open permissions: ugo+rw Jun 25 17:19:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-322ff4e9-2443-43c2-b869-9c1b2e3221fb tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:19 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9 Jun 25 17:19:19 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:19 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2" returned: 0 in 0.930s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:19 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2" released by "delete_volume" :: held 2.085s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:19 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Created reservations ['6cb32f1c-8f8d-4b4b-a8b9-4912dd5011a3', '8efb9a98-87b3-429f-ba7c-de617a9437cd', '9add9a52-00d1-4071-8882-156e1f064d30', 'cec23af3-51af-42fc-8fca-1e84f068279e'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:19:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:19 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:19 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:19 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:19:19 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:20 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-322ff4e9-2443-43c2-b869-9c1b2e3221fb tempest-CinderUnicodeTest-352015495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9" returned: 0 in 1.043s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-322ff4e9-2443-43c2-b869-9c1b2e3221fb tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:20 devstack sudo[108642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.info Jun 25 17:19:20 devstack sudo[108642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:20 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.009s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:20 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:19:20 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Deleted volume successfully. Jun 25 17:19:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-76b47c43-377e-4629-b87f-d5cae23709a9 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-04db2f30-da9c-4e9b-bc7d-f5969d1eeee2-delete_volume" released by "delete_volume" :: held 14.682s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:21 devstack sudo[108642]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-322ff4e9-2443-43c2-b869-9c1b2e3221fb tempest-CinderUnicodeTest-352015495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.info" returned: 0 in 1.011s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:21 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-322ff4e9-2443-43c2-b869-9c1b2e3221fb tempest-CinderUnicodeTest-352015495 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.info is being set with open permissions: ugo+rw Jun 25 17:19:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-322ff4e9-2443-43c2-b869-9c1b2e3221fb tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:21 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.info Jun 25 17:19:21 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:21 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:19:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Flow 'volume_create_manager' (b6d2073c-1788-41a0-90e1-ba13659e6085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e232e975-d997-4d1c-aa0d-37adc03781d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e232e975-d997-4d1c-aa0d-37adc03781d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-689574978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8b185d-3d94-4aa7-97a0-06dda6f69a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e17e999664472e916640cf4b050d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:22Z,use_quota=True,user_id='516e258f2f984293af2543ead13a92e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52684d67-4e8e-4155-b558-5f90d3aa9caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52684d67-4e8e-4155-b558-5f90d3aa9caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607b1068-02ca-4139-9fd3-fb7a82151aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607b1068-02ca-4139-9fd3-fb7a82151aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f8b185d-3d94-4aa7-97a0-06dda6f69a3b', 'volume_name': 'volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9288bd70-a448-4f12-8a50-86b4e352abe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9288bd70-a448-4f12-8a50-86b4e352abe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:21 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c71d28-3927-4c5c-b101-99b1710116a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:21 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Volume 3f8b185d-3d94-4aa7-97a0-06dda6f69a3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b', 'volume_size': 1} Jun 25 17:19:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:22 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-322ff4e9-2443-43c2-b869-9c1b2e3221fb tempest-CinderUnicodeTest-352015495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.info" returned: 0 in 1.033s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-322ff4e9-2443-43c2-b869-9c1b2e3221fb tempest-CinderUnicodeTest-352015495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.726s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.777s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:22 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-689574978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8b185d-3d94-4aa7-97a0-06dda6f69a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e17e999664472e916640cf4b050d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:22Z,use_quota=True,user_id='516e258f2f984293af2543ead13a92e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:19:22 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Creating volume 3f8b185d-3d94-4aa7-97a0-06dda6f69a3b {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:19:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:22 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:22 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:22 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:19:22 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:19:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:22 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b 1073741824 Jun 25 17:19:22 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:22 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-322ff4e9-2443-43c2-b869-9c1b2e3221fb tempest-CinderUnicodeTest-352015495 None] Create snapshot completed successfully Jun 25 17:19:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] Acquiring lock "cinder-41da4e7b-509d-44e0-ade1-80b4bf3592e9-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] Lock "cinder-41da4e7b-509d-44e0-ade1-80b4bf3592e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] Acquiring lock "cinder-quobyte-79265fc0-ccb0-4d39-bad3-84ff09ca5392" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] Lock "cinder-quobyte-79265fc0-ccb0-4d39-bad3-84ff09ca5392" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] Acquiring lock "cinder-quobyte-41da4e7b-509d-44e0-ade1-80b4bf3592e9" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] Lock "cinder-quobyte-41da4e7b-509d-44e0-ade1-80b4bf3592e9" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] Deleting offline snapshot 41da4e7b-509d-44e0-ade1-80b4bf3592e9 of volume 79265fc0-ccb0-4d39-bad3-84ff09ca5392 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:19:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] snapshot_file for this snap is: volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:19:23 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[de125b74-08c0-41f4-90b1-80446511ad4d]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:19:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:23 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9 Jun 25 17:19:23 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:24 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b 1073741824" returned: 0 in 2.050s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:24 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b Jun 25 17:19:24 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:25 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9" returned: 0 in 1.665s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:19:25 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c3fa98-7f59-45fb-8ffd-494f2dd08de8]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:19:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:25 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392 Jun 25 17:19:25 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:26 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b" returned: 0 in 1.317s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] <== create_volume: return (3483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.494s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c71d28-3927-4c5c-b101-99b1710116a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc0a2d7-2c8c-43b9-9f02-5f354b70eed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:26 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Volume volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b (3f8b185d-3d94-4aa7-97a0-06dda6f69a3b): created successfully Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc0a2d7-2c8c-43b9-9f02-5f354b70eed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Flow 'volume_create_manager' (b6d2073c-1788-41a0-90e1-ba13659e6085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:26 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-965e1738-742e-496e-a0ba-3402cae3cc5b tempest-VolumesDeleteCascade-1237155825 None] Created volume successfully. Jun 25 17:19:26 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392" returned: 0 in 1.378s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:26 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9 Jun 25 17:19:26 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Flow 'volume_create_manager' (266a7c86-eb2f-4b35-bc42-dc6c47b3dea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c52ce555-a9f0-4b0c-84ca-f6d972c50333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c52ce555-a9f0-4b0c-84ca-f6d972c50333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-184457767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ad1e308-7588-4c02-92eb-9bf686f99d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f9a25e57a9438a9d7e63944cbb5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:27Z,use_quota=True,user_id='812ee174775e454e8722ffa23d563b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9de5d1-88fe-451f-b5b0-f055ca58a6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae9de5d1-88fe-451f-b5b0-f055ca58a6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288c3891-ce84-45c3-a788-366acbf72d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288c3891-ce84-45c3-a788-366acbf72d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ad1e308-7588-4c02-92eb-9bf686f99d4f', 'volume_name': 'volume-6ad1e308-7588-4c02-92eb-9bf686f99d4f', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b834c98c-adbf-4a29-990d-b905cdb6cbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b834c98c-adbf-4a29-990d-b905cdb6cbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b50a262-b569-4aad-83a8-4751072e318a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:26 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Volume 6ad1e308-7588-4c02-92eb-9bf686f99d4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ad1e308-7588-4c02-92eb-9bf686f99d4f', 'volume_size': 1} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-184457767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ad1e308-7588-4c02-92eb-9bf686f99d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f9a25e57a9438a9d7e63944cbb5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:27Z,use_quota=True,user_id='812ee174775e454e8722ffa23d563b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Creating volume 6ad1e308-7588-4c02-92eb-9bf686f99d4f {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:19:26 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:19:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ad1e308-7588-4c02-92eb-9bf686f99d4f 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:26 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ad1e308-7588-4c02-92eb-9bf686f99d4f 1073741824 Jun 25 17:19:26 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7773bb25-3ce3-42b4-8781-a4f9f554cb31 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:27 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9" returned: 0 in 0.904s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:27 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9 Jun 25 17:19:27 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:27 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ad1e308-7588-4c02-92eb-9bf686f99d4f 1073741824" returned: 0 in 1.046s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ad1e308-7588-4c02-92eb-9bf686f99d4f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:28 devstack sudo[108715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ad1e308-7588-4c02-92eb-9bf686f99d4f Jun 25 17:19:28 devstack sudo[108715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:28 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392.41da4e7b-509d-44e0-ade1-80b4bf3592e9" returned: 0 in 0.817s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] Lock "cinder-quobyte-41da4e7b-509d-44e0-ade1-80b4bf3592e9" released by "_delete_snapshot" :: held 5.026s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] Lock "cinder-quobyte-79265fc0-ccb0-4d39-bad3-84ff09ca5392" released by "delete_snapshot" :: held 5.068s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] Created reservations ['c25121dc-0154-459d-9c9b-84a32d042cb6', '4caa4e0e-b406-403d-a006-e32fab89cf35', '4a4ffedf-be81-4944-bd74-b5296fba55fb', '24a71f26-4d0c-4e3a-9327-2f181a0b6802'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:19:28 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] Delete snapshot completed successfully. Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f614a67a-d5e0-4579-af56-fdc3bcaa9583 tempest-CinderUnicodeTest-352015495 None] Lock "cinder-41da4e7b-509d-44e0-ade1-80b4bf3592e9-delete_snapshot" released by "delete_snapshot" :: held 5.287s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:28 devstack sudo[108715]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ad1e308-7588-4c02-92eb-9bf686f99d4f" returned: 0 in 0.757s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7773bb25-3ce3-42b4-8781-a4f9f554cb31 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.281s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b50a262-b569-4aad-83a8-4751072e318a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ad1e308-7588-4c02-92eb-9bf686f99d4f', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11060d7a-4fc8-411b-b2ea-67d8f065c48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-7773bb25-3ce3-42b4-8781-a4f9f554cb31 tempest-VolumesDeleteCascade-1237155825 None] Creating offline snapshot 7e3c69c7-aa42-4101-9b4c-04bff51f3c2a of volume 3f8b185d-3d94-4aa7-97a0-06dda6f69a3b {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:19:28 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Volume volume-6ad1e308-7588-4c02-92eb-9bf686f99d4f (6ad1e308-7588-4c02-92eb-9bf686f99d4f): created successfully Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11060d7a-4fc8-411b-b2ea-67d8f065c48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Flow 'volume_create_manager' (266a7c86-eb2f-4b35-bc42-dc6c47b3dea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f835cae-cc2c-4bea-8031-f644d2c6109d]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7773bb25-3ce3-42b4-8781-a4f9f554cb31 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] Acquiring lock "cinder-79265fc0-ccb0-4d39-bad3-84ff09ca5392-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:28 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-07d1e43a-eaca-40e8-b184-d96e9fb9540c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Created volume successfully. Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] Lock "cinder-79265fc0-ccb0-4d39-bad3-84ff09ca5392-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] Acquiring lock "cinder-quobyte-79265fc0-ccb0-4d39-bad3-84ff09ca5392" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:28 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] Lock "cinder-quobyte-79265fc0-ccb0-4d39-bad3-84ff09ca5392" acquired by "delete_volume" :: waited 0.018s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:29 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b Jun 25 17:19:29 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:29 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2691866-bb41-4420-8289-99f493098dd3]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:19:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:29 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392 Jun 25 17:19:29 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:29 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7773bb25-3ce3-42b4-8781-a4f9f554cb31 tempest-VolumesDeleteCascade-1237155825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b" returned: 0 in 0.894s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7773bb25-3ce3-42b4-8781-a4f9f554cb31 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:29 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a 1G Jun 25 17:19:29 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:29 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392" returned: 0 in 0.892s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:29 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392 Jun 25 17:19:29 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:30 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:19:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Flow 'volume_create_manager' (876c0db3-f43e-4d95-a073-cca5b96b5f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f277e2-c3ce-47c1-ae6f-0eb6ff0b30e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8f277e2-c3ce-47c1-ae6f-0eb6ff0b30e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-330734426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daabd2f9-a55c-4b02-996d-61d1eafecc3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f9a25e57a9438a9d7e63944cbb5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:31Z,use_quota=True,user_id='812ee174775e454e8722ffa23d563b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f7a13f-bbdb-40e4-8325-a9588637cf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f7a13f-bbdb-40e4-8325-a9588637cf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:30 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5b0311-acd5-4742-9a8b-25a173a4d1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5b0311-acd5-4742-9a8b-25a173a4d1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daabd2f9-a55c-4b02-996d-61d1eafecc3a', 'volume_name': 'volume-daabd2f9-a55c-4b02-996d-61d1eafecc3a', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:30 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee14d3d-9a76-4f70-892d-671d9b1fd99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eee14d3d-9a76-4f70-892d-671d9b1fd99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449a2bae-7ce6-446a-8612-92e8f7d51425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:30 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Volume daabd2f9-a55c-4b02-996d-61d1eafecc3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daabd2f9-a55c-4b02-996d-61d1eafecc3a', 'volume_size': 1} Jun 25 17:19:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7773bb25-3ce3-42b4-8781-a4f9f554cb31 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a 1G" returned: 0 in 1.160s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-79265fc0-ccb0-4d39-bad3-84ff09ca5392" returned: 0 in 1.004s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7773bb25-3ce3-42b4-8781-a4f9f554cb31 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:30 devstack sudo[108780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a Jun 25 17:19:30 devstack sudo[108780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] Lock "cinder-quobyte-79265fc0-ccb0-4d39-bad3-84ff09ca5392" released by "delete_volume" :: held 2.036s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] Created reservations ['cf391e98-f83b-4b2f-b0da-43ba3bf29a43', '4100e7fc-6924-445e-bf6e-a0f560bda228', 'ae21b6ba-08fa-40ff-a5a1-8ecf26344d48', 'c31a1274-c755-4d0e-8409-a3aed4645e91'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:31 devstack sudo[108791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:19:31 devstack sudo[108791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Flow 'volume_create_manager' (98e3a282-4dbe-4a8b-8b6e-97cf239b5014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cf2e75-01b7-4c1c-a9bf-9e601fa9bb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cf2e75-01b7-4c1c-a9bf-9e601fa9bb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1323779846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d46979f-a75c-40fe-9b80-8eeccff39e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f9a25e57a9438a9d7e63944cbb5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:31Z,use_quota=True,user_id='812ee174775e454e8722ffa23d563b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98dc697b-39a5-4426-b996-d02883a6628b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98dc697b-39a5-4426-b996-d02883a6628b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac8356a-83b3-4fbf-a105-0b843f58d45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac8356a-83b3-4fbf-a105-0b843f58d45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d46979f-a75c-40fe-9b80-8eeccff39e68', 'volume_name': 'volume-3d46979f-a75c-40fe-9b80-8eeccff39e68', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a7be68-db05-47c1-8ffe-6e0cdf63dd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a7be68-db05-47c1-8ffe-6e0cdf63dd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ec12ce-2097-43ce-890f-4289b000dc91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:31 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Volume 3d46979f-a75c-40fe-9b80-8eeccff39e68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d46979f-a75c-40fe-9b80-8eeccff39e68', 'volume_size': 1} Jun 25 17:19:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:32 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] Acquiring lock "cinder-542c5fb9-e435-4312-b29e-5d0df12c376a-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:32 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] Lock "cinder-542c5fb9-e435-4312-b29e-5d0df12c376a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:32 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] Acquiring lock "cinder-quobyte-542c5fb9-e435-4312-b29e-5d0df12c376a" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:32 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] Lock "cinder-quobyte-542c5fb9-e435-4312-b29e-5d0df12c376a" acquired by "delete_volume" :: waited 0.051s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:32 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f9ddf0-bd58-4028-9e98-4ae5201ed9df]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:19:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-542c5fb9-e435-4312-b29e-5d0df12c376a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:32 devstack sudo[108780]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7773bb25-3ce3-42b4-8781-a4f9f554cb31 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a" returned: 0 in 1.962s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:32 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-7773bb25-3ce3-42b4-8781-a4f9f554cb31 tempest-VolumesDeleteCascade-1237155825 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a is being set with open permissions: ugo+rw Jun 25 17:19:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7773bb25-3ce3-42b4-8781-a4f9f554cb31 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:32 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:19:32 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a Jun 25 17:19:33 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:33 devstack sudo[108859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-542c5fb9-e435-4312-b29e-5d0df12c376a Jun 25 17:19:33 devstack sudo[108859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Flow 'volume_create_manager' (dc30cf9b-2dd3-448f-bf26-cb5ed8c66260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3936415-f045-4439-9d42-b096ee6a2d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3936415-f045-4439-9d42-b096ee6a2d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1174304019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f9a25e57a9438a9d7e63944cbb5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:33Z,use_quota=True,user_id='812ee174775e454e8722ffa23d563b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d793898a-17ef-4e9f-9807-7d281034a874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d793898a-17ef-4e9f-9807-7d281034a874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd207d0-b06f-4b16-98d9-e70e8b5a38d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd207d0-b06f-4b16-98d9-e70e8b5a38d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2', 'volume_name': 'volume-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3206c5d9-ff7c-49ea-b0a2-9ed908fa7231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3206c5d9-ff7c-49ea-b0a2-9ed908fa7231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c61c2b-ce51-41fd-9c99-4c357848f82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:33 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Volume fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2', 'volume_size': 1} Jun 25 17:19:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:33 devstack sudo[108791]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.973s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:33 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:19:33 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] Deleted volume successfully. Jun 25 17:19:33 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f81f325e-5856-44b3-9789-091a5a334c42 tempest-CinderUnicodeTest-352015495 None] Lock "cinder-79265fc0-ccb0-4d39-bad3-84ff09ca5392-delete_volume" released by "delete_volume" :: held 4.543s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:34 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:19:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Flow 'volume_create_manager' (cd50e540-098d-4822-85c5-43571141f5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f714cb-731f-4133-8ea1-813a44ea079d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f714cb-731f-4133-8ea1-813a44ea079d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-707155489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199e5695-168e-404e-a8c1-64fc5c62ced9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f9a25e57a9438a9d7e63944cbb5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:34Z,use_quota=True,user_id='812ee174775e454e8722ffa23d563b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd00d41-562b-4d74-872a-f1475e34c74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd00d41-562b-4d74-872a-f1475e34c74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781d0518-05e2-4785-9689-4d820b152929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781d0518-05e2-4785-9689-4d820b152929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '199e5695-168e-404e-a8c1-64fc5c62ced9', 'volume_name': 'volume-199e5695-168e-404e-a8c1-64fc5c62ced9', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30acf86d-1071-4a1c-a6c6-32b7e92eb477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30acf86d-1071-4a1c-a6c6-32b7e92eb477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886b41b2-f68b-4a56-8767-7fb2c60c03d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:34 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Volume 199e5695-168e-404e-a8c1-64fc5c62ced9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-199e5695-168e-404e-a8c1-64fc5c62ced9', 'volume_size': 1} Jun 25 17:19:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:35 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7773bb25-3ce3-42b4-8781-a4f9f554cb31 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a" returned: 0 in 2.138s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7773bb25-3ce3-42b4-8781-a4f9f554cb31 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:35 devstack sudo[108859]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-542c5fb9-e435-4312-b29e-5d0df12c376a" returned: 0 in 2.418s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-542c5fb9-e435-4312-b29e-5d0df12c376a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:35 devstack sudo[108884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.info Jun 25 17:19:35 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:35 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-542c5fb9-e435-4312-b29e-5d0df12c376a Jun 25 17:19:35 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:35 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:19:35 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Flow 'volume_create_manager' (ffad12f3-494e-4b3f-ba8a-639b54ffff95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:35 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7acc924f-73c4-46dc-8692-40bf70d1147c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:35 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7acc924f-73c4-46dc-8692-40bf70d1147c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1897804212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bfa3043-d432-4d77-a722-67edc81beced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f9a25e57a9438a9d7e63944cbb5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:35Z,use_quota=True,user_id='812ee174775e454e8722ffa23d563b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:35 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a627480-00cd-41a2-aa58-90c97cb71d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:35 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a627480-00cd-41a2-aa58-90c97cb71d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:35 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44732ad6-8e10-405d-8e47-7cbd65ef7a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:35 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44732ad6-8e10-405d-8e47-7cbd65ef7a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bfa3043-d432-4d77-a722-67edc81beced', 'volume_name': 'volume-8bfa3043-d432-4d77-a722-67edc81beced', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:35 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f367c2ad-ed64-4015-a2a4-bbd36849f2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:35 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f367c2ad-ed64-4015-a2a4-bbd36849f2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:35 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f11323-d645-4289-bfce-857a74018448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:35 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Volume 8bfa3043-d432-4d77-a722-67edc81beced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bfa3043-d432-4d77-a722-67edc81beced', 'volume_size': 1} Jun 25 17:19:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:36 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7773bb25-3ce3-42b4-8781-a4f9f554cb31 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.info" returned: 0 in 1.130s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:36 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-7773bb25-3ce3-42b4-8781-a4f9f554cb31 tempest-VolumesDeleteCascade-1237155825 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.info is being set with open permissions: ugo+rw Jun 25 17:19:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7773bb25-3ce3-42b4-8781-a4f9f554cb31 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:36 devstack sudo[108889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.info Jun 25 17:19:36 devstack sudo[108889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:36 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-542c5fb9-e435-4312-b29e-5d0df12c376a" returned: 0 in 1.270s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:36 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] Lock "cinder-quobyte-542c5fb9-e435-4312-b29e-5d0df12c376a" released by "delete_volume" :: held 3.803s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:36 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] Created reservations ['63d206f7-91c3-4dde-b0cc-a3e76e2813cd', 'bedcae8a-064e-495b-9b19-672e5e1d92d3', 'e7f338f6-bf00-4988-bd91-f7f56b4b2b0b', '07dc4101-6a36-4859-9c19-cd07dddbebe3'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:19:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:36 devstack sudo[108892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:19:36 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:37 devstack sudo[108889]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7773bb25-3ce3-42b4-8781-a4f9f554cb31 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.info" returned: 0 in 1.153s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7773bb25-3ce3-42b4-8781-a4f9f554cb31 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.728s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.602s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:37 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-330734426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daabd2f9-a55c-4b02-996d-61d1eafecc3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f9a25e57a9438a9d7e63944cbb5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:31Z,use_quota=True,user_id='812ee174775e454e8722ffa23d563b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:19:37 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Creating volume daabd2f9-a55c-4b02-996d-61d1eafecc3a {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:19:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:37 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:37 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:37 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:19:37 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:19:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-daabd2f9-a55c-4b02-996d-61d1eafecc3a 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:37 devstack sudo[108895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-daabd2f9-a55c-4b02-996d-61d1eafecc3a 1073741824 Jun 25 17:19:37 devstack sudo[108895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:37 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-7773bb25-3ce3-42b4-8781-a4f9f554cb31 tempest-VolumesDeleteCascade-1237155825 None] Create snapshot completed successfully Jun 25 17:19:37 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.165s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:37 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:19:37 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] Deleted volume successfully. Jun 25 17:19:38 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a1ebfa12-4c34-4f8c-9205-8edb448e30e6 tempest-CinderUnicodeTest-352015495 None] Lock "cinder-542c5fb9-e435-4312-b29e-5d0df12c376a-delete_volume" released by "delete_volume" :: held 5.456s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:38 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:19:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Flow 'volume_create_manager' (9874f3b1-8012-4b0c-bbb6-a5f0d9c725d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7447d71-5bef-4699-a456-f0b4042e89bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7447d71-5bef-4699-a456-f0b4042e89bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-469983743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12867559-ff83-451f-a14b-794be5401ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db9559a28d3048e1bb06e3125ae5315d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:39Z,use_quota=True,user_id='f7998ea9e31b4494b9f055d5cc504e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61478ea-2757-48b2-a398-07ed7eb4d74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61478ea-2757-48b2-a398-07ed7eb4d74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d9159c-d25e-4716-96a3-f67898b4110e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d9159c-d25e-4716-96a3-f67898b4110e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12867559-ff83-451f-a14b-794be5401ea2', 'volume_name': 'volume-12867559-ff83-451f-a14b-794be5401ea2', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5f8592-cf37-44e6-bca8-788ca88ece16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5f8592-cf37-44e6-bca8-788ca88ece16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251d9864-6cce-494c-aae0-e8c6b6a2756a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:38 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Volume 12867559-ff83-451f-a14b-794be5401ea2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12867559-ff83-451f-a14b-794be5401ea2', 'volume_size': 1} Jun 25 17:19:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:39 devstack sudo[108895]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-daabd2f9-a55c-4b02-996d-61d1eafecc3a 1073741824" returned: 0 in 1.763s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-daabd2f9-a55c-4b02-996d-61d1eafecc3a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:39 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-daabd2f9-a55c-4b02-996d-61d1eafecc3a Jun 25 17:19:39 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:39 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Flow 'volume_create_manager' (14c20dd9-931a-4c7a-a074-d453ccab7fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93220683-520b-4961-b171-b3987b1c82bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93220683-520b-4961-b171-b3987b1c82bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1378477305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9cf5b3a-dbb1-46f0-bb56-9272a56055bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4e17e999664472e916640cf4b050d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7e3c69c7-aa42-4101-9b4c-04bff51f3c2a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:40Z,use_quota=True,user_id='516e258f2f984293af2543ead13a92e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58987140-1477-4e63-9313-0d19a0092f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58987140-1477-4e63-9313-0d19a0092f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37509ec0-eda4-4c0c-a472-0268ed92f29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37509ec0-eda4-4c0c-a472-0268ed92f29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e9cf5b3a-dbb1-46f0-bb56-9272a56055bd', 'volume_name': 'volume-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd', 'volume_size': 1, 'snapshot_id': '7e3c69c7-aa42-4101-9b4c-04bff51f3c2a'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b961e495-4666-4370-a0a7-c78be310d932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b961e495-4666-4370-a0a7-c78be310d932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b54c30-7ba4-480f-b44a-7f8dcc8aad6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:40 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Volume e9cf5b3a-dbb1-46f0-bb56-9272a56055bd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd', 'volume_size': 1, 'snapshot_id': '7e3c69c7-aa42-4101-9b4c-04bff51f3c2a'} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:40 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-daabd2f9-a55c-4b02-996d-61d1eafecc3a" returned: 0 in 0.997s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] <== create_volume: return (2866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.872s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.689s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1323779846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d46979f-a75c-40fe-9b80-8eeccff39e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f9a25e57a9438a9d7e63944cbb5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:31Z,use_quota=True,user_id='812ee174775e454e8722ffa23d563b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Creating volume 3d46979f-a75c-40fe-9b80-8eeccff39e68 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:19:40 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3d46979f-a75c-40fe-9b80-8eeccff39e68 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449a2bae-7ce6-446a-8612-92e8f7d51425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daabd2f9-a55c-4b02-996d-61d1eafecc3a', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c35b7c-cf22-4451-9e4a-a07992f541ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:40 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3d46979f-a75c-40fe-9b80-8eeccff39e68 1073741824 Jun 25 17:19:40 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:40 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Volume volume-daabd2f9-a55c-4b02-996d-61d1eafecc3a (daabd2f9-a55c-4b02-996d-61d1eafecc3a): created successfully Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c35b7c-cf22-4451-9e4a-a07992f541ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Flow 'volume_create_manager' (876c0db3-f43e-4d95-a073-cca5b96b5f98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:40 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b2389be5-be53-42c7-99aa-a7116bdf89b7 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Created volume successfully. Jun 25 17:19:41 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3d46979f-a75c-40fe-9b80-8eeccff39e68 1073741824" returned: 0 in 1.054s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3d46979f-a75c-40fe-9b80-8eeccff39e68 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:41 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3d46979f-a75c-40fe-9b80-8eeccff39e68 Jun 25 17:19:41 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:42 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3d46979f-a75c-40fe-9b80-8eeccff39e68" returned: 0 in 0.768s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:19:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.080s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1174304019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f9a25e57a9438a9d7e63944cbb5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:33Z,use_quota=True,user_id='812ee174775e454e8722ffa23d563b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:19:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Creating volume fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:19:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:19:42 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:19:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:42 devstack sudo[108914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2 1073741824 Jun 25 17:19:42 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4ec12ce-2097-43ce-890f-4289b000dc91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d46979f-a75c-40fe-9b80-8eeccff39e68', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1c344a-9dbf-451b-a6fc-5033de27a4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:42 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Volume volume-3d46979f-a75c-40fe-9b80-8eeccff39e68 (3d46979f-a75c-40fe-9b80-8eeccff39e68): created successfully Jun 25 17:19:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc1c344a-9dbf-451b-a6fc-5033de27a4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Flow 'volume_create_manager' (98e3a282-4dbe-4a8b-8b6e-97cf239b5014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:42 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-247780b3-e73f-4b7f-98ce-e0d2a1a080eb tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Created volume successfully. Jun 25 17:19:43 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2 1073741824" returned: 0 in 1.069s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:43 devstack sudo[108920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2 Jun 25 17:19:43 devstack sudo[108920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:44 devstack sudo[108920]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2" returned: 0 in 0.802s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] <== create_volume: return (1927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.778s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-707155489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=199e5695-168e-404e-a8c1-64fc5c62ced9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f9a25e57a9438a9d7e63944cbb5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:34Z,use_quota=True,user_id='812ee174775e454e8722ffa23d563b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Creating volume 199e5695-168e-404e-a8c1-64fc5c62ced9 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:19:44 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-199e5695-168e-404e-a8c1-64fc5c62ced9 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:44 devstack sudo[108923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-199e5695-168e-404e-a8c1-64fc5c62ced9 1073741824 Jun 25 17:19:44 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:44 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:19:44 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c61c2b-ce51-41fd-9c99-4c357848f82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893140a6-ea14-4710-abab-5cffc7e5f06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:44 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Volume volume-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2 (fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2): created successfully Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (893140a6-ea14-4710-abab-5cffc7e5f06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Flow 'volume_create_manager' (dc30cf9b-2dd3-448f-bf26-cb5ed8c66260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:44 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-c847a049-2ca0-4e74-bde3-b4a9d190e6f6 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Created volume successfully. Jun 25 17:19:45 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.855s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:19:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:19:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 28 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:19:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:19:45 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-199e5695-168e-404e-a8c1-64fc5c62ced9 1073741824" returned: 0 in 1.088s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-199e5695-168e-404e-a8c1-64fc5c62ced9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:45 devstack sudo[108932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-199e5695-168e-404e-a8c1-64fc5c62ced9 Jun 25 17:19:45 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:46 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-199e5695-168e-404e-a8c1-64fc5c62ced9" returned: 0 in 0.849s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:19:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.475s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1897804212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bfa3043-d432-4d77-a722-67edc81beced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f9a25e57a9438a9d7e63944cbb5531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:35Z,use_quota=True,user_id='812ee174775e454e8722ffa23d563b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:19:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Creating volume 8bfa3043-d432-4d77-a722-67edc81beced {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:19:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:19:46 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:19:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-8bfa3043-d432-4d77-a722-67edc81beced 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:46 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=114,cinder:SELECT=95,cinder:INSERT=25,cinder:DELETE=9 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:19:46 devstack sudo[108935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-8bfa3043-d432-4d77-a722-67edc81beced 1073741824 Jun 25 17:19:46 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886b41b2-f68b-4a56-8767-7fb2c60c03d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-199e5695-168e-404e-a8c1-64fc5c62ced9', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf97f12a-5be0-48a5-9e8f-26fc3c95ac4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:46 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:DELETE=10,cinder:UPDATE=105,cinder:SELECT=86,cinder:INSERT=31 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:19:46 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Volume volume-199e5695-168e-404e-a8c1-64fc5c62ced9 (199e5695-168e-404e-a8c1-64fc5c62ced9): created successfully Jun 25 17:19:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf97f12a-5be0-48a5-9e8f-26fc3c95ac4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Flow 'volume_create_manager' (cd50e540-098d-4822-85c5-43571141f5f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:46 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-15042161-75c9-4ed6-bffa-f2d236736f31 tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Created volume successfully. Jun 25 17:19:47 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-8bfa3043-d432-4d77-a722-67edc81beced 1073741824" returned: 0 in 1.066s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-8bfa3043-d432-4d77-a722-67edc81beced {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:47 devstack sudo[108941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-8bfa3043-d432-4d77-a722-67edc81beced Jun 25 17:19:47 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:48 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-8bfa3043-d432-4d77-a722-67edc81beced" returned: 0 in 0.735s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.117s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-469983743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12867559-ff83-451f-a14b-794be5401ea2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db9559a28d3048e1bb06e3125ae5315d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:19:39Z,use_quota=True,user_id='f7998ea9e31b4494b9f055d5cc504e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Creating volume 12867559-ff83-451f-a14b-794be5401ea2 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:19:48 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-12867559-ff83-451f-a14b-794be5401ea2 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:48 devstack sudo[108959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-12867559-ff83-451f-a14b-794be5401ea2 1073741824 Jun 25 17:19:48 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66f11323-d645-4289-bfce-857a74018448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bfa3043-d432-4d77-a722-67edc81beced', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbf570a-2f6d-45dd-aed1-0f842b8915f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:48 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Volume volume-8bfa3043-d432-4d77-a722-67edc81beced (8bfa3043-d432-4d77-a722-67edc81beced): created successfully Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbf570a-2f6d-45dd-aed1-0f842b8915f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Flow 'volume_create_manager' (ffad12f3-494e-4b3f-ba8a-639b54ffff95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:48 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-3a59b75e-9673-48af-93a3-44819c61851c tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Created volume successfully. Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "cinder-8bfa3043-d432-4d77-a722-67edc81beced-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-8bfa3043-d432-4d77-a722-67edc81beced-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "cinder-quobyte-8bfa3043-d432-4d77-a722-67edc81beced" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-quobyte-8bfa3043-d432-4d77-a722-67edc81beced" acquired by "delete_volume" :: waited 0.018s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[498784f0-df55-423c-ba4d-85ab3f0383ff]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:19:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-8bfa3043-d432-4d77-a722-67edc81beced {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:49 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-8bfa3043-d432-4d77-a722-67edc81beced Jun 25 17:19:49 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:49 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-12867559-ff83-451f-a14b-794be5401ea2 1073741824" returned: 0 in 1.071s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-12867559-ff83-451f-a14b-794be5401ea2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:49 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-12867559-ff83-451f-a14b-794be5401ea2 Jun 25 17:19:49 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:49 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-8bfa3043-d432-4d77-a722-67edc81beced" returned: 0 in 0.940s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-8bfa3043-d432-4d77-a722-67edc81beced {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:49 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-8bfa3043-d432-4d77-a722-67edc81beced Jun 25 17:19:49 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:50 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-12867559-ff83-451f-a14b-794be5401ea2" returned: 0 in 0.845s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.924s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "cinder-quobyte-7e3c69c7-aa42-4101-9b4c-04bff51f3c2a-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd" by "_create_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251d9864-6cce-494c-aae0-e8c6b6a2756a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12867559-ff83-451f-a14b-794be5401ea2', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521a6523-ea1f-48b9-9d2a-f12364f389db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-7e3c69c7-aa42-4101-9b4c-04bff51f3c2a-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Creating volume e9cf5b3a-dbb1-46f0-bb56-9272a56055bd from snapshot 7e3c69c7-aa42-4101-9b4c-04bff51f3c2a {{(pid=93869) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "cinder-quobyte-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd" by "_copy_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] snapshot: 7e3c69c7-aa42-4101-9b4c-04bff51f3c2a, volume: e9cf5b3a-dbb1-46f0-bb56-9272a56055bd, {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 17:19:50 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Volume volume-12867559-ff83-451f-a14b-794be5401ea2 (12867559-ff83-451f-a14b-794be5401ea2): created successfully Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (521a6523-ea1f-48b9-9d2a-f12364f389db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Flow 'volume_create_manager' (9874f3b1-8012-4b0c-bbb6-a5f0d9c725d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:50 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-321c4bad-e00b-4a2d-a993-515b02a225be tempest-TestMinimumBasicScenario-158847587 None] Created volume successfully. Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9dcbf7-4e02-4ac5-a71a-10e68c0c097f]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:50 devstack sudo[108975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a Jun 25 17:19:50 devstack sudo[108975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:50 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-8bfa3043-d432-4d77-a722-67edc81beced" returned: 0 in 0.915s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-quobyte-8bfa3043-d432-4d77-a722-67edc81beced" released by "delete_volume" :: held 1.900s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Created reservations ['2b1a234d-5ac1-4e13-8cc5-3fcd995d6b57', '4249e5b9-0d2a-43fa-a838-2a097e418af0', '7aef0309-a2f6-44b8-a7cb-59e34205fa93', '98544608-b12e-4d2a-a6c6-0545efe0273c'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:51 devstack sudo[108978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:19:51 devstack sudo[108978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:51 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "cinder-199e5695-168e-404e-a8c1-64fc5c62ced9-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:51 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-199e5695-168e-404e-a8c1-64fc5c62ced9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:51 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "cinder-quobyte-199e5695-168e-404e-a8c1-64fc5c62ced9" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:51 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-quobyte-199e5695-168e-404e-a8c1-64fc5c62ced9" acquired by "delete_volume" :: waited 0.019s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:51 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[499daaed-566f-4b0c-aba9-279811681efd]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:19:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-199e5695-168e-404e-a8c1-64fc5c62ced9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:51 devstack sudo[108975]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a" returned: 0 in 1.131s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:51 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:19:51 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] will copy from snapshot at /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 17:19:51 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Creating direct copy from snapshot {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 17:19:51 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b4a18d-4662-453d-b86c-1de94e27d45e]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:19:51 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-199e5695-168e-404e-a8c1-64fc5c62ced9 Jun 25 17:19:51 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:51 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b Jun 25 17:19:51 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:51 devstack sudo[108978]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.882s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:51 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:19:51 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Deleted volume successfully. Jun 25 17:19:51 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7180c47a-6bb9-48af-84ab-8d512295db3b tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-8bfa3043-d432-4d77-a722-67edc81beced-delete_volume" released by "delete_volume" :: held 3.069s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:52 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-199e5695-168e-404e-a8c1-64fc5c62ced9" returned: 0 in 0.874s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-199e5695-168e-404e-a8c1-64fc5c62ced9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:52 devstack sudo[108994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-199e5695-168e-404e-a8c1-64fc5c62ced9 Jun 25 17:19:52 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:52 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b" returned: 0 in 1.044s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:52 devstack cinder-volume[93869]: DEBUG cinder.utils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Path /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd not found in is_blk_device check {{(pid=93869) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 17:19:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:52 devstack sudo[108999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd Jun 25 17:19:52 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:52 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-199e5695-168e-404e-a8c1-64fc5c62ced9" returned: 0 in 0.801s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-quobyte-199e5695-168e-404e-a8c1-64fc5c62ced9" released by "delete_volume" :: held 1.754s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:53 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Created reservations ['8b580ee1-bfeb-4bb2-8917-41ef52c6e2d5', 'b1f4aa94-c679-4932-82b2-6b413d098d3a', '51cd3618-9358-4b2f-a349-ddd4145b4ffe', '3c2b828b-3c4f-47d6-a24b-d02b26bef019'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:19:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:53 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:53 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:53 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:19:53 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:53 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "cinder-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:53 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:53 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "cinder-quobyte-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:53 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-quobyte-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2" acquired by "delete_volume" :: waited 0.049s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:53 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[021ac655-7f3d-470b-b380-e088c83c0e0c]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:19:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:54 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2 Jun 25 17:19:54 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:55 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 2.115s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:55 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:19:55 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Deleted volume successfully. Jun 25 17:19:55 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-ea110c58-a3fe-43ef-9938-b7a0e7c6854a tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-199e5695-168e-404e-a8c1-64fc5c62ced9-delete_volume" released by "delete_volume" :: held 4.302s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-5305015a-ff52-4c7f-b64d-b94e825f4958 req-5580bc84-c665-400c-b8bc-66cc48c33f4e tempest-TestMinimumBasicScenario-158847587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:56 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2" returned: 0 in 2.936s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:56 devstack sudo[109037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2 Jun 25 17:19:56 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:58 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2" returned: 0 in 1.908s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-quobyte-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2" released by "delete_volume" :: held 4.979s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:19:58 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Created reservations ['b1a9b8b9-ecf8-48f9-9cfd-feefa5f97ba8', '475cf869-3140-4fa9-923a-5b96c98e2254', '455a509e-3f9c-4ead-9b49-10fa99a3c156', 'f447e390-17ee-48a8-b2fd-4eec77d3ff2d'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:19:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:19:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:19:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:19:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:19:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:19:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:59 devstack sudo[109047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:19:59 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:59 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root Jun 25 17:19:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd" returned: 0 in 7.186s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:19:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "cinder-3d46979f-a75c-40fe-9b80-8eeccff39e68-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:59 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[480d9a32-2878-4087-ae94-f0286d02e11e]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:19:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:19:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-3d46979f-a75c-40fe-9b80-8eeccff39e68-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "cinder-quobyte-3d46979f-a75c-40fe-9b80-8eeccff39e68" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:19:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-quobyte-3d46979f-a75c-40fe-9b80-8eeccff39e68" acquired by "delete_volume" :: waited 0.032s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:19:59 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b Jun 25 17:19:59 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:19:59 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[463bb3bd-4e36-49ba-bc1c-e75025f8e7de]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:19:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3d46979f-a75c-40fe-9b80-8eeccff39e68 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:00 devstack sudo[109051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3d46979f-a75c-40fe-9b80-8eeccff39e68 Jun 25 17:20:00 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:00 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.155s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:00 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:20:00 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Deleted volume successfully. Jun 25 17:20:00 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-14eda438-7ca1-4f19-9e29-8d3819fa492d tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-fb1f1835-bfb9-4f6d-8d17-8d81c7e155b2-delete_volume" released by "delete_volume" :: held 6.692s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:00 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3d46979f-a75c-40fe-9b80-8eeccff39e68" returned: 0 in 0.823s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3d46979f-a75c-40fe-9b80-8eeccff39e68 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:00 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3d46979f-a75c-40fe-9b80-8eeccff39e68 Jun 25 17:20:00 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:00 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b" returned: 0 in 1.150s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:00 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Image conversion details: src /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b, size 1024.00 MB, duration 7.19 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:20:00 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Converted 1024.00 MB image at 142.45 MB/s Jun 25 17:20:00 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd is being set with open permissions: ugo+rw Jun 25 17:20:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:00 devstack sudo[109062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd Jun 25 17:20:00 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:01 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd" returned: 0 in 0.665s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:01 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd" released by "_copy_volume_from_snapshot" :: held 11.383s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3d46979f-a75c-40fe-9b80-8eeccff39e68" returned: 0 in 0.813s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-7e3c69c7-aa42-4101-9b4c-04bff51f3c2a-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd" released by "_create_volume_from_snapshot" :: held 11.432s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.479s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-5305015a-ff52-4c7f-b64d-b94e825f4958 req-5580bc84-c665-400c-b8bc-66cc48c33f4e tempest-TestMinimumBasicScenario-158847587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.100s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-quobyte-3d46979f-a75c-40fe-9b80-8eeccff39e68" released by "delete_volume" :: held 1.715s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[99474f6a-5d9a-4701-b1e3-1361dbec8b10]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-5305015a-ff52-4c7f-b64d-b94e825f4958 req-5580bc84-c665-400c-b8bc-66cc48c33f4e tempest-TestMinimumBasicScenario-158847587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-12867559-ff83-451f-a14b-794be5401ea2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b54c30-7ba4-480f-b44a-7f8dcc8aad6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd', 'volume_size': 1, 'snapshot_id': '7e3c69c7-aa42-4101-9b4c-04bff51f3c2a'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f57243-3b5a-4747-bbfd-b1cf13ecb509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:01 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Volume volume-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd (e9cf5b3a-dbb1-46f0-bb56-9272a56055bd): created successfully Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f57243-3b5a-4747-bbfd-b1cf13ecb509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Flow 'volume_create_manager' (14c20dd9-931a-4c7a-a074-d453ccab7fb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:20:01 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-12867559-ff83-451f-a14b-794be5401ea2 Jun 25 17:20:01 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Created reservations ['345f45cc-0523-478f-a9c6-799b9f62e3ee', 'c09f6df3-e162-4fc8-a0ac-00630d545705', '7e9164b7-f963-4f28-a8b6-add9a36deb87', '60f298a7-fe54-444b-a705-a22e7a87f6f4'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:20:01 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-182b40d8-a82b-4ed8-b755-94fa5538fb23 tempest-VolumesDeleteCascade-1237155825 None] Created volume successfully. Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:20:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:01 devstack sudo[109068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:20:01 devstack sudo[109068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "cinder-daabd2f9-a55c-4b02-996d-61d1eafecc3a-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-daabd2f9-a55c-4b02-996d-61d1eafecc3a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "cinder-quobyte-daabd2f9-a55c-4b02-996d-61d1eafecc3a" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-quobyte-daabd2f9-a55c-4b02-996d-61d1eafecc3a" acquired by "delete_volume" :: waited 0.022s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[81581c9e-6202-4b82-afa3-3f7dee62b5a2]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-daabd2f9-a55c-4b02-996d-61d1eafecc3a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "cinder-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Performing cascade delete. {{(pid=93869) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "cinder-7e3c69c7-aa42-4101-9b4c-04bff51f3c2a-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-7e3c69c7-aa42-4101-9b4c-04bff51f3c2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "cinder-quobyte-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:02 devstack sudo[109072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-daabd2f9-a55c-4b02-996d-61d1eafecc3a Jun 25 17:20:02 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "cinder-quobyte-7e3c69c7-aa42-4101-9b4c-04bff51f3c2a" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:02 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-7e3c69c7-aa42-4101-9b4c-04bff51f3c2a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Deleting offline snapshot 7e3c69c7-aa42-4101-9b4c-04bff51f3c2a of volume 3f8b185d-3d94-4aa7-97a0-06dda6f69a3b {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] snapshot_file for this snap is: volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-5305015a-ff52-4c7f-b64d-b94e825f4958 req-5580bc84-c665-400c-b8bc-66cc48c33f4e tempest-TestMinimumBasicScenario-158847587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-12867559-ff83-451f-a14b-794be5401ea2" returned: 0 in 1.034s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-5305015a-ff52-4c7f-b64d-b94e825f4958 req-5580bc84-c665-400c-b8bc-66cc48c33f4e tempest-TestMinimumBasicScenario-158847587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.062s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecde897-7be0-478a-a896-efa97698245a]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-5305015a-ff52-4c7f-b64d-b94e825f4958 req-5580bc84-c665-400c-b8bc-66cc48c33f4e tempest-TestMinimumBasicScenario-158847587 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-12867559-ff83-451f-a14b-794be5401ea2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8da1c5ad-89a2-4ded-8d0a-6793dc775784', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:20:02 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-5305015a-ff52-4c7f-b64d-b94e825f4958 req-5580bc84-c665-400c-b8bc-66cc48c33f4e tempest-TestMinimumBasicScenario-158847587 None] attachment_update completed successfully. Jun 25 17:20:02 devstack sudo[109068]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.021s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:20:02 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Deleted volume successfully. Jun 25 17:20:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-beaa20e0-3045-4811-a8ca-2fa870f93b3f tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-3d46979f-a75c-40fe-9b80-8eeccff39e68-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:02 devstack sudo[109076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a Jun 25 17:20:02 devstack sudo[109076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:03 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-daabd2f9-a55c-4b02-996d-61d1eafecc3a" returned: 0 in 1.258s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-daabd2f9-a55c-4b02-996d-61d1eafecc3a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:03 devstack sudo[109151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-daabd2f9-a55c-4b02-996d-61d1eafecc3a Jun 25 17:20:03 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:03 devstack sudo[109076]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a" returned: 0 in 1.188s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:03 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:20:03 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dc4a84-7cce-4b6f-a54d-972c55b35623]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:04 devstack sudo[109473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b Jun 25 17:20:04 devstack sudo[109473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:04 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-daabd2f9-a55c-4b02-996d-61d1eafecc3a" returned: 0 in 0.785s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-quobyte-daabd2f9-a55c-4b02-996d-61d1eafecc3a" released by "delete_volume" :: held 2.117s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:04 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Created reservations ['db9194f7-7c10-4152-92a9-062a3c923c7f', 'a5891e0e-2d6b-4c9a-9eee-895eb55df805', '1cad73a7-2b5c-4c4c-8c36-159cacb57606', '9a8e2efc-6f02-473b-b6ea-c97d13dab3cb'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:20:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:20:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:20:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:20:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:20:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:20:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:04 devstack sudo[109478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:20:04 devstack sudo[109478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "cinder-6ad1e308-7588-4c02-92eb-9bf686f99d4f-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-6ad1e308-7588-4c02-92eb-9bf686f99d4f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "cinder-quobyte-6ad1e308-7588-4c02-92eb-9bf686f99d4f" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-quobyte-6ad1e308-7588-4c02-92eb-9bf686f99d4f" acquired by "delete_volume" :: waited 0.021s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:04 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[12299bc8-7955-4667-bb72-5d6b979b41c8]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ad1e308-7588-4c02-92eb-9bf686f99d4f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:05 devstack sudo[109473]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:05 devstack sudo[109484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ad1e308-7588-4c02-92eb-9bf686f99d4f Jun 25 17:20:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b" returned: 0 in 1.121s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:05 devstack sudo[109484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:05 devstack sudo[109486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a Jun 25 17:20:05 devstack sudo[109486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:05 devstack sudo[109478]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.937s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:05 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:20:05 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Deleted volume successfully. Jun 25 17:20:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5da9b833-068a-413a-8e0c-dc414f07b11e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-daabd2f9-a55c-4b02-996d-61d1eafecc3a-delete_volume" released by "delete_volume" :: held 3.456s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:05 devstack sudo[109484]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ad1e308-7588-4c02-92eb-9bf686f99d4f" returned: 0 in 1.020s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ad1e308-7588-4c02-92eb-9bf686f99d4f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:05 devstack sudo[109495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ad1e308-7588-4c02-92eb-9bf686f99d4f Jun 25 17:20:05 devstack sudo[109495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:05 devstack sudo[109486]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a" returned: 0 in 0.977s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:06 devstack sudo[109497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a Jun 25 17:20:06 devstack sudo[109497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:06 devstack sudo[109495]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6ad1e308-7588-4c02-92eb-9bf686f99d4f" returned: 0 in 0.772s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-quobyte-6ad1e308-7588-4c02-92eb-9bf686f99d4f" released by "delete_volume" :: held 1.862s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:06 devstack sudo[109497]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:06 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Created reservations ['9975fda6-5f27-438e-88e2-0758b8a4cc3c', '19ce113c-59de-486a-b911-e912d89ecd9f', '2e79ae40-792e-40c2-a2b8-b561c7d8f598', '5b0d19a3-d1f7-4dd5-9eed-a78232d78dfe'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:20:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b.7e3c69c7-aa42-4101-9b4c-04bff51f3c2a" returned: 0 in 0.828s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-7e3c69c7-aa42-4101-9b4c-04bff51f3c2a" released by "_delete_snapshot" :: held 4.273s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b" released by "delete_snapshot" :: held 4.316s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:20:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:20:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:20:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:20:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:20:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:07 devstack sudo[109501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:20:07 devstack sudo[109501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:07 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Created reservations ['79abee84-e587-4dda-8529-375063f4e815', 'e5b382cb-3f30-4f48-b53c-7adeaea065ec', 'eb6e8579-e9de-4c76-8612-7bbc60cac1c8', 'dbcebc9f-87e5-4b71-a950-00632e90d682'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:20:07 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Delete snapshot completed successfully. Jun 25 17:20:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-7e3c69c7-aa42-4101-9b4c-04bff51f3c2a-delete_snapshot" released by "delete_snapshot" :: held 4.595s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Snapshots deleted, issuing volume delete {{(pid=93869) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 25 17:20:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "cinder-quobyte-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b" acquired by "delete_volume" :: waited 0.020s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:07 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc2a193-5f36-466f-b036-5117677d4896]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:07 devstack sudo[109503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b Jun 25 17:20:07 devstack sudo[109503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:07 devstack sudo[109501]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.872s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:07 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:20:07 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Deleted volume successfully. Jun 25 17:20:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3c73ff3f-c791-411a-b5a3-86c03113fb0e tempest-CreateVolumesFromSourceVolumeTest-1736187234 None] Lock "cinder-6ad1e308-7588-4c02-92eb-9bf686f99d4f-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:08 devstack sudo[109503]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b" returned: 0 in 1.094s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:08 devstack sudo[109509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b Jun 25 17:20:08 devstack sudo[109509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:09 devstack sudo[109509]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b" returned: 0 in 0.912s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b" released by "delete_volume" :: held 2.106s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:09 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Created reservations ['a4a8bc41-3808-4e45-a79f-60bdff8739fc', '794e1f77-49d0-40dd-99c2-78c92b7206d5', '1442b918-210a-466e-8e99-f9c9dd5589b0', 'e704cf27-9978-454a-8afb-5087b4b86299'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:20:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:20:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:20:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:20:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:20:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:20:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:09 devstack sudo[109513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:20:09 devstack sudo[109513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:10 devstack sudo[109513]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.803s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:10 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:20:10 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Deleted volume successfully. Jun 25 17:20:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-83dfb958-1d04-43a6-ad59-3c484119e226 tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-3f8b185d-3d94-4aa7-97a0-06dda6f69a3b-delete_volume" released by "delete_volume" :: held 7.929s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "cinder-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "cinder-quobyte-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd" acquired by "delete_volume" :: waited 0.022s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:10 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d50d41d-baa2-4871-b81c-aae1fc74821b]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:10 devstack sudo[109516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd Jun 25 17:20:10 devstack sudo[109516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:11 devstack sudo[109516]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd" returned: 0 in 1.012s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:11 devstack sudo[109522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd Jun 25 17:20:11 devstack sudo[109522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:12 devstack sudo[109522]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd" returned: 0 in 1.011s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:12 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-quobyte-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd" released by "delete_volume" :: held 2.093s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:12 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] Created reservations ['41822007-df86-4718-bfa2-92d685dc2d76', '146e819c-addd-46be-b153-1795bee3678c', '7ba79211-8ab6-409d-8139-83e00eb10c95', '1ca0dd92-f688-453c-968e-89212d735898'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:20:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:20:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:20:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:20:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:20:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:20:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:12 devstack sudo[109526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:20:12 devstack sudo[109526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:13 devstack sudo[109526]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.953s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:13 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:20:13 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] Deleted volume successfully. Jun 25 17:20:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-981c0482-e9fd-4291-bbb4-c0cdf9395b2f tempest-VolumesDeleteCascade-1237155825 None] Lock "cinder-e9cf5b3a-dbb1-46f0-bb56-9272a56055bd-delete_volume" released by "delete_volume" :: held 3.503s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:15 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:20:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Flow 'volume_create_manager' (2f308ecd-7f65-47bc-936b-41291f8c9fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:20:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14104ccf-0520-45fb-b588-fdc73b50d138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14104ccf-0520-45fb-b588-fdc73b50d138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4aab304-17cb-4389-9493-0bc65ad0635a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4197c3c5e0994337ab5f82c8b4c841c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:20:15Z,use_quota=True,user_id='525bd0c40e354759b2322c56f424d9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c448b0eb-41b2-4caf-b43c-147e2a22c742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c448b0eb-41b2-4caf-b43c-147e2a22c742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:15 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f12a050-953c-4dd0-a7b1-8db17806249b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:15 devstack cinder-volume[93869]: DEBUG cinder.image.glance [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Creating Keystone auth plugin from conf {{(pid=93869) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 17:20:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f12a050-953c-4dd0-a7b1-8db17806249b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b4aab304-17cb-4389-9493-0bc65ad0635a', 'volume_name': 'volume-b4aab304-17cb-4389-9493-0bc65ad0635a', 'volume_size': 1, 'image_id': 'b4b73c9d-7683-4e2d-a7ac-21d46bcf716c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4b73c9d-7683-4e2d-a7ac-21d46bcf716c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0bc88eeb437c36047f8c34a83df834ce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4197c3c5e0994337ab5f82c8b4c841c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1dea3b7fe05b18390a22b5f2f9f050b799d081d8a7895406370d52488e339de5631212d7ecead6eff72c36051082a972d01eac89596e2d017354f2d99d5b1a34', 'id': 'b4b73c9d-7683-4e2d-a7ac-21d46bcf716c', 'created_at': datetime.datetime(2026, 6, 25, 15, 20, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 20, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4b73c9d-7683-4e2d-a7ac-21d46bcf716c/file', 'properties': {}}, 'image_service': }' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919bac1a-528e-47c8-b9f1-7fb5c4841fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (919bac1a-528e-47c8-b9f1-7fb5c4841fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0612a54a-8e31-4464-b8ba-572fecb6bdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:16 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Volume b4aab304-17cb-4389-9493-0bc65ad0635a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b4aab304-17cb-4389-9493-0bc65ad0635a', 'volume_size': 1, 'image_id': 'b4b73c9d-7683-4e2d-a7ac-21d46bcf716c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4b73c9d-7683-4e2d-a7ac-21d46bcf716c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0bc88eeb437c36047f8c34a83df834ce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4197c3c5e0994337ab5f82c8b4c841c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1dea3b7fe05b18390a22b5f2f9f050b799d081d8a7895406370d52488e339de5631212d7ecead6eff72c36051082a972d01eac89596e2d017354f2d99d5b1a34', 'id': 'b4b73c9d-7683-4e2d-a7ac-21d46bcf716c', 'created_at': datetime.datetime(2026, 6, 25, 15, 20, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 20, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4b73c9d-7683-4e2d-a7ac-21d46bcf716c/file', 'properties': {}}, 'image_service': } Jun 25 17:20:16 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Trying to clone b4aab304-17cb-4389-9493-0bc65ad0635a from image b4b73c9d-7683-4e2d-a7ac-21d46bcf716c at location (None, [{'url': 'file:///opt/stack/data/glance/images/b4b73c9d-7683-4e2d-a7ac-21d46bcf716c', 'metadata': {}}]). {{(pid=93869) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 17:20:16 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 17:20:16 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Image download 0.00 MB at 0.00 MB/s Jun 25 17:20:16 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2532944-7c8c-437b-9296-162cac23767e]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:16 devstack sudo[109531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD Jun 25 17:20:16 devstack sudo[109531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:17 devstack sudo[109531]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD" returned: 0 in 1.094s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:17 devstack sudo[109535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD Jun 25 17:20:17 devstack sudo[109535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:18 devstack sudo[109535]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD" returned: 1 in 1.039s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:20:18 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Temporary image b4b73c9d-7683-4e2d-a7ac-21d46bcf716c is fetched for user 525bd0c40e354759b2322c56f424d9ee. {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 17:20:18 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[419f6566-7a82-4417-9c6f-09735ef8130f]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:18 devstack sudo[109545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD Jun 25 17:20:18 devstack sudo[109545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:19 devstack sudo[109545]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD" returned: 0 in 0.932s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:19 devstack sudo[109549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD Jun 25 17:20:19 devstack sudo[109549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:20 devstack sudo[109549]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD" returned: 1 in 1.122s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:20:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:20:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:20:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4aab304-17cb-4389-9493-0bc65ad0635a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4197c3c5e0994337ab5f82c8b4c841c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:20:15Z,use_quota=True,user_id='525bd0c40e354759b2322c56f424d9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:20:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Creating volume b4aab304-17cb-4389-9493-0bc65ad0635a {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:20:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:20:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:20:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:20:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:20:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:20:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:20:20 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:20:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:20 devstack sudo[109554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a 1073741824 Jun 25 17:20:20 devstack sudo[109554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:21 devstack sudo[109554]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a 1073741824" returned: 0 in 1.193s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:21 devstack sudo[109560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a Jun 25 17:20:21 devstack sudo[109560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:22 devstack sudo[109560]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a" returned: 0 in 0.917s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:22 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:20:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.168s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:20:22 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Attempting download of b4b73c9d-7683-4e2d-a7ac-21d46bcf716c ((None, [{'url': 'file:///opt/stack/data/glance/images/b4b73c9d-7683-4e2d-a7ac-21d46bcf716c', 'metadata': {}}])) to volume b4aab304-17cb-4389-9493-0bc65ad0635a. {{(pid=93869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 17:20:22 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0da45a-34e8-447e-9830-20ccd4ef4d7b]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_eaxtuadv {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:23 devstack sudo[109563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_eaxtuadv Jun 25 17:20:23 devstack sudo[109563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:23 devstack sudo[109563]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_eaxtuadv" returned: 0 in 0.908s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_eaxtuadv {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:23 devstack sudo[109592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_eaxtuadv Jun 25 17:20:23 devstack sudo[109592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:24 devstack sudo[109592]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_eaxtuadv" returned: 1 in 1.003s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_eaxtuadv' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:20:24 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5848380-5829-4083-8fab-2638f9d87566]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:24 devstack sudo[109596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD Jun 25 17:20:24 devstack sudo[109596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:25 devstack sudo[109596]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD" returned: 0 in 1.132s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:26 devstack sudo[109642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD Jun 25 17:20:26 devstack sudo[109642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:27 devstack sudo[109642]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD" returned: 1 in 1.316s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:20:27 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] b4b73c9d-7683-4e2d-a7ac-21d46bcf716c was raw, converting to raw {{(pid=93869) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 17:20:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:27 devstack sudo[109673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a Jun 25 17:20:27 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:29 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a" returned: 0 in 1.721s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:29 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b4b73c9d-7683-4e2d-a7ac-21d46bcf716c_tixxppmcdevstack@QuobyteHD, size 0.00 MB, duration 1.72 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:20:29 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Converted 0.00 MB image at 0.00 MB/s Jun 25 17:20:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:29 devstack sudo[109729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a 1G Jun 25 17:20:29 devstack sudo[109729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:30 devstack sudo[109729]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a 1G" returned: 0 in 1.622s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:30 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4109c4f-a496-4111-9cdf-d737d588d3fd]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:30 devstack sudo[109738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a Jun 25 17:20:30 devstack sudo[109738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:31 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=82,cinder:SELECT=49,cinder:INSERT=21,cinder:DELETE=6 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:20:31 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:20:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Flow 'volume_create_manager' (e6f734a7-e73b-41bd-a3a0-9110a1d3b1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:20:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb69ff4-04c5-40ac-8cfa-4688d1498f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb69ff4-04c5-40ac-8cfa-4688d1498f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-679688726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc71e3da-2882-43b1-9bf2-2a84ffa08546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800d647bfa8a4109bd357f307ce103d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:20:32Z,use_quota=True,user_id='3bffd13855f44efdb234662e5428a1f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c1ed2d-8fe8-47e1-8b3b-f56d9d000a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c1ed2d-8fe8-47e1-8b3b-f56d9d000a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9582e3-ce58-4421-96f6-a7b6643c1a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9582e3-ce58-4421-96f6-a7b6643c1a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc71e3da-2882-43b1-9bf2-2a84ffa08546', 'volume_name': 'volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffd6bb7-6544-462d-8ad6-517820c00c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffd6bb7-6544-462d-8ad6-517820c00c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9cf85b-486b-41d9-bf5b-dd503ecf2a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:32 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Volume dc71e3da-2882-43b1-9bf2-2a84ffa08546: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546', 'volume_size': 1} Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-679688726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc71e3da-2882-43b1-9bf2-2a84ffa08546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800d647bfa8a4109bd357f307ce103d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:20:32Z,use_quota=True,user_id='3bffd13855f44efdb234662e5428a1f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Creating volume dc71e3da-2882-43b1-9bf2-2a84ffa08546 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:20:32 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:32 devstack sudo[109775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546 1073741824 Jun 25 17:20:32 devstack sudo[109775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:32 devstack sudo[109738]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a" returned: 0 in 1.911s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:33 devstack sudo[109779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a Jun 25 17:20:33 devstack sudo[109779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:33 devstack sudo[109775]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546 1073741824" returned: 0 in 1.548s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:33 devstack sudo[109788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546 Jun 25 17:20:33 devstack sudo[109788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:33 devstack sudo[109779]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a" returned: 1 in 1.233s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:20:33 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Downloaded image b4b73c9d-7683-4e2d-a7ac-21d46bcf716c ((None, [{'url': 'file:///opt/stack/data/glance/images/b4b73c9d-7683-4e2d-a7ac-21d46bcf716c', 'metadata': {}}])) to volume b4aab304-17cb-4389-9493-0bc65ad0635a successfully. {{(pid=93869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 17:20:33 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Temporary image b4b73c9d-7683-4e2d-a7ac-21d46bcf716c for user 525bd0c40e354759b2322c56f424d9ee is deleted. {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 17:20:33 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Marking volume b4aab304-17cb-4389-9493-0bc65ad0635a as bootable. {{(pid=93869) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 17:20:33 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Copying metadata from image b4b73c9d-7683-4e2d-a7ac-21d46bcf716c to b4aab304-17cb-4389-9493-0bc65ad0635a. {{(pid=93869) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 17:20:33 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Creating volume glance metadata for volume b4aab304-17cb-4389-9493-0bc65ad0635a backed by image b4b73c9d-7683-4e2d-a7ac-21d46bcf716c with: {'image_id': 'b4b73c9d-7683-4e2d-a7ac-21d46bcf716c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '0bc88eeb437c36047f8c34a83df834ce', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93869) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 17:20:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0612a54a-8e31-4464-b8ba-572fecb6bdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4aab304-17cb-4389-9493-0bc65ad0635a', 'volume_size': 1, 'image_id': 'b4b73c9d-7683-4e2d-a7ac-21d46bcf716c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4b73c9d-7683-4e2d-a7ac-21d46bcf716c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0bc88eeb437c36047f8c34a83df834ce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4197c3c5e0994337ab5f82c8b4c841c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1dea3b7fe05b18390a22b5f2f9f050b799d081d8a7895406370d52488e339de5631212d7ecead6eff72c36051082a972d01eac89596e2d017354f2d99d5b1a34', 'id': 'b4b73c9d-7683-4e2d-a7ac-21d46bcf716c', 'created_at': datetime.datetime(2026, 6, 25, 15, 20, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 20, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4b73c9d-7683-4e2d-a7ac-21d46bcf716c/file', 'properties': {}}, 'image_service': }' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c2327a0-7671-435d-97a8-f6e76e4d8cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:34 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Volume volume-b4aab304-17cb-4389-9493-0bc65ad0635a (b4aab304-17cb-4389-9493-0bc65ad0635a): created successfully Jun 25 17:20:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c2327a0-7671-435d-97a8-f6e76e4d8cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Flow 'volume_create_manager' (2f308ecd-7f65-47bc-936b-41291f8c9fea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:20:34 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-c77c5bf5-6038-4a11-9457-9861657d7820 tempest-VolumeImageDependencyTests-30013288 None] Created volume successfully. Jun 25 17:20:34 devstack sudo[109788]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546" returned: 0 in 0.836s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:34 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] <== create_volume: return (2474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:20:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.479s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:20:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9cf85b-486b-41d9-bf5b-dd503ecf2a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a5e52b-a851-4031-9ea9-ce2afb8312ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:34 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Volume volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546 (dc71e3da-2882-43b1-9bf2-2a84ffa08546): created successfully Jun 25 17:20:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a5e52b-a851-4031-9ea9-ce2afb8312ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Flow 'volume_create_manager' (e6f734a7-e73b-41bd-a3a0-9110a1d3b1e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:20:34 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-1d7eb41a-8c5c-4316-a7b1-81f640a75d64 tempest-VolumesSnapshotTestJSON-2050396882 None] Created volume successfully. Jun 25 17:20:35 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] Acquiring lock "cinder-b4aab304-17cb-4389-9493-0bc65ad0635a-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:35 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] Lock "cinder-b4aab304-17cb-4389-9493-0bc65ad0635a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:35 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] Acquiring lock "cinder-quobyte-b4aab304-17cb-4389-9493-0bc65ad0635a" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:35 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] Lock "cinder-quobyte-b4aab304-17cb-4389-9493-0bc65ad0635a" acquired by "delete_volume" :: waited 0.022s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:35 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e051642f-2e18-4ac8-a382-cd5140d94035]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-42e4b52a-c759-464d-ac75-dbd37e175dca tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:20:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-42e4b52a-c759-464d-ac75-dbd37e175dca tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:20:35 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-42e4b52a-c759-464d-ac75-dbd37e175dca tempest-VolumesSnapshotTestJSON-2050396882 None] Creating offline snapshot 8027f6ae-21a4-4a34-bbd0-c182bf581101 of volume dc71e3da-2882-43b1-9bf2-2a84ffa08546 {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:20:35 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c3ccec-8ffe-4f9e-a4fa-c9c701184565]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-42e4b52a-c759-464d-ac75-dbd37e175dca tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:35 devstack sudo[109794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a Jun 25 17:20:35 devstack sudo[109794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:35 devstack sudo[109795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546 Jun 25 17:20:35 devstack sudo[109795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:36 devstack sudo[109794]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a" returned: 0 in 0.956s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:36 devstack sudo[109795]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-42e4b52a-c759-464d-ac75-dbd37e175dca tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546" returned: 0 in 0.945s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-42e4b52a-c759-464d-ac75-dbd37e175dca tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:36 devstack sudo[109805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101 1G Jun 25 17:20:36 devstack sudo[109805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:36 devstack sudo[109804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a Jun 25 17:20:36 devstack sudo[109804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:37 devstack sudo[109804]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a" returned: 1 in 0.892s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:20:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:37 devstack sudo[109814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a Jun 25 17:20:37 devstack sudo[109814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:37 devstack sudo[109805]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-42e4b52a-c759-464d-ac75-dbd37e175dca tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101 1G" returned: 0 in 0.921s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-42e4b52a-c759-464d-ac75-dbd37e175dca tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:37 devstack sudo[109816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101 Jun 25 17:20:37 devstack sudo[109816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:38 devstack sudo[109814]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-b4aab304-17cb-4389-9493-0bc65ad0635a" returned: 0 in 0.791s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:38 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] Lock "cinder-quobyte-b4aab304-17cb-4389-9493-0bc65ad0635a" released by "delete_volume" :: held 2.813s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:38 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] Created reservations ['af6973c6-d069-4bea-bab6-38232359f270', '07a8e3bf-9082-4cf7-b8e3-e66b5965002d', 'c0cda19f-39cc-4c6d-9582-dd8d59ee05e0', '57927be7-3f8a-4830-82f8-bbf862392689'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:20:38 devstack sudo[109816]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-42e4b52a-c759-464d-ac75-dbd37e175dca tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101" returned: 0 in 0.844s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:38 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-42e4b52a-c759-464d-ac75-dbd37e175dca tempest-VolumesSnapshotTestJSON-2050396882 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101 is being set with open permissions: ugo+rw Jun 25 17:20:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-42e4b52a-c759-464d-ac75-dbd37e175dca tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:20:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:20:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:20:38 devstack sudo[109823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101 Jun 25 17:20:38 devstack sudo[109823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:20:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:20:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:38 devstack sudo[109825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:20:38 devstack sudo[109825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:39 devstack sudo[109825]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.177s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:39 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:20:39 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] Deleted volume successfully. Jun 25 17:20:39 devstack sudo[109823]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-42e4b52a-c759-464d-ac75-dbd37e175dca tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101" returned: 0 in 1.254s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:39 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b121b5a5-38a9-49c0-b5d2-fb3d3aeaa7e0 tempest-VolumeImageDependencyTests-30013288 None] Lock "cinder-b4aab304-17cb-4389-9493-0bc65ad0635a-delete_volume" released by "delete_volume" :: held 4.355s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-42e4b52a-c759-464d-ac75-dbd37e175dca tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:39 devstack sudo[109829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.info Jun 25 17:20:39 devstack sudo[109829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:40 devstack sudo[109829]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-42e4b52a-c759-464d-ac75-dbd37e175dca tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.info" returned: 0 in 0.918s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:40 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-42e4b52a-c759-464d-ac75-dbd37e175dca tempest-VolumesSnapshotTestJSON-2050396882 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.info is being set with open permissions: ugo+rw Jun 25 17:20:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-42e4b52a-c759-464d-ac75-dbd37e175dca tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:40 devstack sudo[109833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.info Jun 25 17:20:40 devstack sudo[109833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:41 devstack sudo[109833]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-42e4b52a-c759-464d-ac75-dbd37e175dca tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.info" returned: 0 in 0.845s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-42e4b52a-c759-464d-ac75-dbd37e175dca tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.860s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:20:41 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-42e4b52a-c759-464d-ac75-dbd37e175dca tempest-VolumesSnapshotTestJSON-2050396882 None] Create snapshot completed successfully Jun 25 17:20:42 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-8027f6ae-21a4-4a34-bbd0-c182bf581101-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:42 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-8027f6ae-21a4-4a34-bbd0-c182bf581101-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:42 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-quobyte-dc71e3da-2882-43b1-9bf2-2a84ffa08546" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:42 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-dc71e3da-2882-43b1-9bf2-2a84ffa08546" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:42 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-quobyte-8027f6ae-21a4-4a34-bbd0-c182bf581101" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:42 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-8027f6ae-21a4-4a34-bbd0-c182bf581101" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] Deleting offline snapshot 8027f6ae-21a4-4a34-bbd0-c182bf581101 of volume dc71e3da-2882-43b1-9bf2-2a84ffa08546 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:20:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] snapshot_file for this snap is: volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:20:42 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[947771de-7ea6-4b31-a846-5a1f2a3bb8c1]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:42 devstack sudo[109836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101 Jun 25 17:20:42 devstack sudo[109836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:43 devstack sudo[109836]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101" returned: 0 in 0.919s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:20:43 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[944e97ac-f81a-497d-b3a7-c362d7cb2259]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:43 devstack sudo[109854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546 Jun 25 17:20:43 devstack sudo[109854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:44 devstack sudo[109854]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546" returned: 0 in 0.855s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:44 devstack sudo[109860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101 Jun 25 17:20:44 devstack sudo[109860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:20:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:20:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:20:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:20:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:20:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:20:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:44 devstack sudo[109862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:20:44 devstack sudo[109862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:44 devstack sudo[109860]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101" returned: 0 in 0.843s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:45 devstack sudo[109862]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.753s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:20:45 devstack sudo[109868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101 Jun 25 17:20:45 devstack sudo[109868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:20:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 28 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:20:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:20:45 devstack sudo[109868]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546.8027f6ae-21a4-4a34-bbd0-c182bf581101" returned: 0 in 0.680s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:45 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-8027f6ae-21a4-4a34-bbd0-c182bf581101" released by "_delete_snapshot" :: held 3.415s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:45 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-dc71e3da-2882-43b1-9bf2-2a84ffa08546" released by "delete_snapshot" :: held 3.445s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:45 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] Created reservations ['2cb5443f-ebc0-47ac-b2a4-2d0fb5d69dba', '3160151c-b3b0-40b6-b85f-4ef36097e161', '2945248d-5bb2-43d6-ab7a-7cf03153d201', 'c7e0e934-ca56-466a-8c4c-94c73ab0bc68'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:20:45 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] Delete snapshot completed successfully. Jun 25 17:20:45 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a5a089ba-0e31-402e-8acb-9ffd8c4e75ee tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-8027f6ae-21a4-4a34-bbd0-c182bf581101-delete_snapshot" released by "delete_snapshot" :: held 3.665s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=98,cinder:DELETE=8,cinder:SELECT=88,cinder:INSERT=26 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Flow 'volume_create_manager' (65951147-a6c0-42ee-802c-0f1ee8cd1495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4428a7-5c74-4f62-8ef4-198444e6247f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db4428a7-5c74-4f62-8ef4-198444e6247f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-228915859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f474833-86e8-4fd5-bfd3-7539bc10b51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800d647bfa8a4109bd357f307ce103d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:20:47Z,use_quota=True,user_id='3bffd13855f44efdb234662e5428a1f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e985ef-be59-4a90-a0d4-1a4b65aa100b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e985ef-be59-4a90-a0d4-1a4b65aa100b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55edb6b1-dbad-4737-84a9-969d7fdeb5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55edb6b1-dbad-4737-84a9-969d7fdeb5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f474833-86e8-4fd5-bfd3-7539bc10b51a', 'volume_name': 'volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7358aa25-0a16-4e44-83ed-e7e96d89a88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7358aa25-0a16-4e44-83ed-e7e96d89a88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23781447-9910-42d4-898d-4b6e352c99e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:47 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Volume 2f474833-86e8-4fd5-bfd3-7539bc10b51a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a', 'volume_size': 1} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-228915859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f474833-86e8-4fd5-bfd3-7539bc10b51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800d647bfa8a4109bd357f307ce103d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:20:47Z,use_quota=True,user_id='3bffd13855f44efdb234662e5428a1f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Creating volume 2f474833-86e8-4fd5-bfd3-7539bc10b51a {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:20:47 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:20:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:47 devstack sudo[109871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a 1073741824 Jun 25 17:20:47 devstack sudo[109871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:48 devstack sudo[109871]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a 1073741824" returned: 0 in 0.879s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:48 devstack sudo[109876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a Jun 25 17:20:48 devstack sudo[109876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:48 devstack sudo[109876]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a" returned: 0 in 0.670s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:20:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:20:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23781447-9910-42d4-898d-4b6e352c99e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872e9470-c465-4e77-b88c-85153eea4ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:48 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Volume volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a (2f474833-86e8-4fd5-bfd3-7539bc10b51a): created successfully Jun 25 17:20:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872e9470-c465-4e77-b88c-85153eea4ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Flow 'volume_create_manager' (65951147-a6c0-42ee-802c-0f1ee8cd1495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:20:48 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-5190dd31-4fc6-49a4-abf8-2fd619297ce2 tempest-VolumesSnapshotTestJSON-2050396882 None] Created volume successfully. Jun 25 17:20:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-55a38838-7cd9-4eba-8dcc-c0128c68a05c tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:20:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-55a38838-7cd9-4eba-8dcc-c0128c68a05c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:20:49 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-55a38838-7cd9-4eba-8dcc-c0128c68a05c tempest-VolumesSnapshotTestJSON-2050396882 None] Creating offline snapshot dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 of volume 2f474833-86e8-4fd5-bfd3-7539bc10b51a {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:20:49 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[afacdbc6-1075-490c-b523-708759e6182d]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-55a38838-7cd9-4eba-8dcc-c0128c68a05c tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:49 devstack sudo[109879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a Jun 25 17:20:49 devstack sudo[109879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:50 devstack sudo[109879]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-55a38838-7cd9-4eba-8dcc-c0128c68a05c tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a" returned: 0 in 0.893s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-55a38838-7cd9-4eba-8dcc-c0128c68a05c tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:50 devstack sudo[109884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 1G Jun 25 17:20:50 devstack sudo[109884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:51 devstack sudo[109884]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-55a38838-7cd9-4eba-8dcc-c0128c68a05c tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 1G" returned: 0 in 1.033s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-55a38838-7cd9-4eba-8dcc-c0128c68a05c tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:51 devstack sudo[109889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 Jun 25 17:20:51 devstack sudo[109889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:52 devstack sudo[109889]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-55a38838-7cd9-4eba-8dcc-c0128c68a05c tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731" returned: 0 in 0.758s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:52 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-55a38838-7cd9-4eba-8dcc-c0128c68a05c tempest-VolumesSnapshotTestJSON-2050396882 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 is being set with open permissions: ugo+rw Jun 25 17:20:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-55a38838-7cd9-4eba-8dcc-c0128c68a05c tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:52 devstack sudo[109894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 Jun 25 17:20:52 devstack sudo[109894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:52 devstack sudo[109894]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-55a38838-7cd9-4eba-8dcc-c0128c68a05c tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731" returned: 0 in 0.712s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-55a38838-7cd9-4eba-8dcc-c0128c68a05c tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:52 devstack sudo[109901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.info Jun 25 17:20:52 devstack sudo[109901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:53 devstack sudo[109901]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-55a38838-7cd9-4eba-8dcc-c0128c68a05c tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.info" returned: 0 in 0.745s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:53 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-55a38838-7cd9-4eba-8dcc-c0128c68a05c tempest-VolumesSnapshotTestJSON-2050396882 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.info is being set with open permissions: ugo+rw Jun 25 17:20:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-55a38838-7cd9-4eba-8dcc-c0128c68a05c tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:53 devstack sudo[109906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.info Jun 25 17:20:53 devstack sudo[109906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:54 devstack sudo[109906]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-55a38838-7cd9-4eba-8dcc-c0128c68a05c tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.info" returned: 0 in 0.873s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-55a38838-7cd9-4eba-8dcc-c0128c68a05c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.121s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:20:54 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-55a38838-7cd9-4eba-8dcc-c0128c68a05c tempest-VolumesSnapshotTestJSON-2050396882 None] Create snapshot completed successfully Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Flow 'volume_create_manager' (1b3d4902-3b81-443c-8c98-a980d014fd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438165c0-02cd-4524-b604-b2b90f2a4ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438165c0-02cd-4524-b604-b2b90f2a4ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1771305178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb431424-419b-495e-b1ae-1a9dbc47f351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800d647bfa8a4109bd357f307ce103d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:20:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=dd8202e0-cf6f-4a65-aafe-75c8ed1d2731,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:20:56Z,use_quota=True,user_id='3bffd13855f44efdb234662e5428a1f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977096aa-7eda-4e04-8966-ab62866ef95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977096aa-7eda-4e04-8966-ab62866ef95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9017b2f7-09f6-4cde-a2c8-7776b9e53008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9017b2f7-09f6-4cde-a2c8-7776b9e53008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cb431424-419b-495e-b1ae-1a9dbc47f351', 'volume_name': 'volume-cb431424-419b-495e-b1ae-1a9dbc47f351', 'volume_size': 2, 'snapshot_id': 'dd8202e0-cf6f-4a65-aafe-75c8ed1d2731'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468c430e-2b4b-4045-892d-baceb9898dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468c430e-2b4b-4045-892d-baceb9898dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceaf2b4c-f13f-4e86-8699-5605eaaecc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:20:56 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Volume cb431424-419b-495e-b1ae-1a9dbc47f351: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cb431424-419b-495e-b1ae-1a9dbc47f351', 'volume_size': 2, 'snapshot_id': 'dd8202e0-cf6f-4a65-aafe-75c8ed1d2731'} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-quobyte-dd8202e0-cf6f-4a65-aafe-75c8ed1d2731-cb431424-419b-495e-b1ae-1a9dbc47f351" by "_create_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-dd8202e0-cf6f-4a65-aafe-75c8ed1d2731-cb431424-419b-495e-b1ae-1a9dbc47f351" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Creating volume cb431424-419b-495e-b1ae-1a9dbc47f351 from snapshot dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 {{(pid=93869) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-quobyte-cb431424-419b-495e-b1ae-1a9dbc47f351" by "_copy_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-cb431424-419b-495e-b1ae-1a9dbc47f351" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] snapshot: dd8202e0-cf6f-4a65-aafe-75c8ed1d2731, volume: cb431424-419b-495e-b1ae-1a9dbc47f351, {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0767edc2-df79-4a7a-884a-be21d91b71b1]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:56 devstack sudo[109919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 Jun 25 17:20:56 devstack sudo[109919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:57 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-f1606a82-99a6-429b-afb0-b432a3350a97 req-ed8ea2ce-464d-4ec3-9c95-a6e6f45bd848 tempest-TestMinimumBasicScenario-158847587 None] Terminate volume connection completed successfully. Jun 25 17:20:57 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-f1606a82-99a6-429b-afb0-b432a3350a97 req-ed8ea2ce-464d-4ec3-9c95-a6e6f45bd848 tempest-TestMinimumBasicScenario-158847587 None] Deleting attachment 8da1c5ad-89a2-4ded-8d0a-6793dc775784. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:20:57 devstack sudo[109919]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731" returned: 0 in 0.959s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:57 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:20:57 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] will copy from snapshot at /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 17:20:57 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Creating direct copy from snapshot {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 17:20:57 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[164a750e-6390-4a38-bf4a-59ce4aa20855]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:57 devstack sudo[109930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a Jun 25 17:20:57 devstack sudo[109930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:58 devstack sudo[109930]: pam_unix(sudo:session): session closed for user root Jun 25 17:20:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a" returned: 0 in 0.911s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:20:58 devstack cinder-volume[93869]: DEBUG cinder.utils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Path /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cb431424-419b-495e-b1ae-1a9dbc47f351 not found in is_blk_device check {{(pid=93869) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 17:20:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cb431424-419b-495e-b1ae-1a9dbc47f351 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:58 devstack sudo[109935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cb431424-419b-495e-b1ae-1a9dbc47f351 Jun 25 17:20:58 devstack sudo[109935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:20:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] Acquiring lock "cinder-12867559-ff83-451f-a14b-794be5401ea2-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] Lock "cinder-12867559-ff83-451f-a14b-794be5401ea2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] Acquiring lock "cinder-quobyte-12867559-ff83-451f-a14b-794be5401ea2" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:20:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] Lock "cinder-quobyte-12867559-ff83-451f-a14b-794be5401ea2" acquired by "delete_volume" :: waited 0.022s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:20:59 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7c77f7-0c26-40a5-a14c-e97147f7ace7]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:20:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-12867559-ff83-451f-a14b-794be5401ea2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:20:59 devstack sudo[109946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-12867559-ff83-451f-a14b-794be5401ea2 Jun 25 17:20:59 devstack sudo[109946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:00 devstack sudo[109946]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-12867559-ff83-451f-a14b-794be5401ea2" returned: 0 in 1.481s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-12867559-ff83-451f-a14b-794be5401ea2 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:00 devstack sudo[109959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-12867559-ff83-451f-a14b-794be5401ea2 Jun 25 17:21:00 devstack sudo[109959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:02 devstack sudo[109959]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-12867559-ff83-451f-a14b-794be5401ea2" returned: 0 in 1.937s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] Lock "cinder-quobyte-12867559-ff83-451f-a14b-794be5401ea2" released by "delete_volume" :: held 3.500s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:02 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] Created reservations ['fdc40e45-6a69-49cd-8207-f106ecb7832f', 'f82c8714-02d5-48a6-bb9f-7ae6cd0ab88c', '21a03372-e997-462f-b65c-65011cbc2be8', 'd8e4c7d7-6672-428e-a5f6-32b8ef345fd5'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:21:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:03 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:21:03 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:21:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:03 devstack sudo[109962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:21:03 devstack sudo[109962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:04 devstack sudo[109935]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cb431424-419b-495e-b1ae-1a9dbc47f351" returned: 0 in 6.159s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:04 devstack sudo[109962]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.477s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:04 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:21:04 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dfadb3-bcf0-4371-a60e-9a63f9f894fe]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:21:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:04 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] Deleted volume successfully. Jun 25 17:21:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-92d55e9b-5d39-4e34-8782-52eb7b1eff84 tempest-TestMinimumBasicScenario-158847587 None] Lock "cinder-12867559-ff83-451f-a14b-794be5401ea2-delete_volume" released by "delete_volume" :: held 5.646s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:04 devstack sudo[109966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a Jun 25 17:21:04 devstack sudo[109966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:05 devstack sudo[109966]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a" returned: 0 in 1.326s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:05 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Image conversion details: src /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a, size 1024.00 MB, duration 6.16 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cb431424-419b-495e-b1ae-1a9dbc47f351 {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:21:05 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Converted 1024.00 MB image at 166.22 MB/s Jun 25 17:21:05 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cb431424-419b-495e-b1ae-1a9dbc47f351 is being set with open permissions: ugo+rw Jun 25 17:21:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cb431424-419b-495e-b1ae-1a9dbc47f351 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:05 devstack sudo[110010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cb431424-419b-495e-b1ae-1a9dbc47f351 Jun 25 17:21:05 devstack sudo[110010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:06 devstack sudo[110010]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cb431424-419b-495e-b1ae-1a9dbc47f351" returned: 0 in 0.751s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-cb431424-419b-495e-b1ae-1a9dbc47f351" released by "_copy_volume_from_snapshot" :: held 10.264s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-dd8202e0-cf6f-4a65-aafe-75c8ed1d2731-cb431424-419b-495e-b1ae-1a9dbc47f351" released by "_create_volume_from_snapshot" :: held 10.301s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.316s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceaf2b4c-f13f-4e86-8699-5605eaaecc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb431424-419b-495e-b1ae-1a9dbc47f351', 'volume_size': 2, 'snapshot_id': 'dd8202e0-cf6f-4a65-aafe-75c8ed1d2731'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4aeb4b-8349-40ec-827d-75d16b578c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:06 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Volume volume-cb431424-419b-495e-b1ae-1a9dbc47f351 (cb431424-419b-495e-b1ae-1a9dbc47f351): created successfully Jun 25 17:21:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d4aeb4b-8349-40ec-827d-75d16b578c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Flow 'volume_create_manager' (1b3d4902-3b81-443c-8c98-a980d014fd35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:21:06 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-3f6e950c-5340-4469-9735-0a91b14e4f46 tempest-VolumesSnapshotTestJSON-2050396882 None] Created volume successfully. Jun 25 17:21:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-cb431424-419b-495e-b1ae-1a9dbc47f351-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-cb431424-419b-495e-b1ae-1a9dbc47f351-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-quobyte-cb431424-419b-495e-b1ae-1a9dbc47f351" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-cb431424-419b-495e-b1ae-1a9dbc47f351" acquired by "delete_volume" :: waited 0.017s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:07 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a794cb-3a75-46fa-b2d3-841f41b6c3e1]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:21:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cb431424-419b-495e-b1ae-1a9dbc47f351 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:07 devstack sudo[110016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cb431424-419b-495e-b1ae-1a9dbc47f351 Jun 25 17:21:07 devstack sudo[110016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:08 devstack sudo[110016]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cb431424-419b-495e-b1ae-1a9dbc47f351" returned: 0 in 0.846s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cb431424-419b-495e-b1ae-1a9dbc47f351 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:08 devstack sudo[110021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cb431424-419b-495e-b1ae-1a9dbc47f351 Jun 25 17:21:08 devstack sudo[110021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:09 devstack sudo[110021]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-cb431424-419b-495e-b1ae-1a9dbc47f351" returned: 0 in 0.655s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-cb431424-419b-495e-b1ae-1a9dbc47f351" released by "delete_volume" :: held 1.548s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:09 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] Created reservations ['50d23e38-c53b-4bb4-b4de-8707b0694924', 'bb8a44c8-dd23-494b-9410-ced379dbb5c8', '2372b80a-d7a6-43b3-a740-6ee034a4d3d9', '48640faa-baf4-4a91-af73-b81c491c9d40'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:21:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:21:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:21:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:09 devstack sudo[110025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:21:09 devstack sudo[110025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-dd8202e0-cf6f-4a65-aafe-75c8ed1d2731-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-dd8202e0-cf6f-4a65-aafe-75c8ed1d2731-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-quobyte-2f474833-86e8-4fd5-bfd3-7539bc10b51a" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-2f474833-86e8-4fd5-bfd3-7539bc10b51a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-quobyte-dd8202e0-cf6f-4a65-aafe-75c8ed1d2731" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-dd8202e0-cf6f-4a65-aafe-75c8ed1d2731" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] Deleting offline snapshot dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 of volume 2f474833-86e8-4fd5-bfd3-7539bc10b51a {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:21:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] snapshot_file for this snap is: volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:21:09 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87f58fe-dd36-4814-9477-e1568e466e21]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:21:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:10 devstack sudo[110025]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.775s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:10 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:21:10 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] Deleted volume successfully. Jun 25 17:21:10 devstack sudo[110028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 Jun 25 17:21:10 devstack sudo[110028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-bbbab2c5-6a18-4578-b057-fe942f46a052 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-cb431424-419b-495e-b1ae-1a9dbc47f351-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:10 devstack sudo[110028]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731" returned: 0 in 0.906s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:21:10 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd99d3f-e6c6-44eb-8507-df7d29368ce1]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:21:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:11 devstack sudo[110033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a Jun 25 17:21:11 devstack sudo[110033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:11 devstack sudo[110033]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a" returned: 0 in 0.898s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:11 devstack sudo[110038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 Jun 25 17:21:11 devstack sudo[110038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:12 devstack sudo[110038]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731" returned: 0 in 0.897s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:12 devstack sudo[110044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731 Jun 25 17:21:12 devstack sudo[110044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:13 devstack sudo[110044]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a.dd8202e0-cf6f-4a65-aafe-75c8ed1d2731" returned: 0 in 0.749s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-dd8202e0-cf6f-4a65-aafe-75c8ed1d2731" released by "_delete_snapshot" :: held 3.589s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-2f474833-86e8-4fd5-bfd3-7539bc10b51a" released by "delete_snapshot" :: held 3.620s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:13 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] Created reservations ['6ecc2d02-9123-409d-90fb-3473caae292d', 'efb5dc1b-eb92-4589-887a-5b2219933256', 'b8078ae9-0746-46a0-945f-5d8c86fa36d1', '4b664118-594b-4d7a-8f59-292d6eda2aad'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:21:13 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] Delete snapshot completed successfully. Jun 25 17:21:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-28c106d9-6950-44bb-8e55-e8076fc84c8c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-dd8202e0-cf6f-4a65-aafe-75c8ed1d2731-delete_snapshot" released by "delete_snapshot" :: held 3.833s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:14 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-2f474833-86e8-4fd5-bfd3-7539bc10b51a-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:14 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-2f474833-86e8-4fd5-bfd3-7539bc10b51a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:14 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-quobyte-2f474833-86e8-4fd5-bfd3-7539bc10b51a" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:14 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-2f474833-86e8-4fd5-bfd3-7539bc10b51a" acquired by "delete_volume" :: waited 0.015s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:14 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[af860b0a-1413-4f93-875e-d4a12a7c1768]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:21:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:14 devstack sudo[110049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a Jun 25 17:21:14 devstack sudo[110049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:15 devstack sudo[110049]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a" returned: 0 in 0.954s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:15 devstack sudo[110056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a Jun 25 17:21:15 devstack sudo[110056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:16 devstack sudo[110056]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2f474833-86e8-4fd5-bfd3-7539bc10b51a" returned: 0 in 0.850s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:16 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-2f474833-86e8-4fd5-bfd3-7539bc10b51a" released by "delete_volume" :: held 1.876s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:16 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] Created reservations ['0a57fa61-0951-44ca-9b65-d16aa52b6add', '1e517eff-62b8-4e9a-875e-60cad4992577', 'ae089702-4ed0-4c35-99a3-2720c036265d', 'ea70d705-218e-42b6-be41-c3f0a3df0c52'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:21:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:21:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:21:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:16 devstack sudo[110060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:21:16 devstack sudo[110060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:17 devstack sudo[110060]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.896s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:21:17 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] Deleted volume successfully. Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Flow 'volume_create_manager' (bc17db2a-624c-47b7-8cff-cc0a8cc56687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc21c55-f837-4f58-a233-2c065fb6aa35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc21c55-f837-4f58-a233-2c065fb6aa35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-585497802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e496ad-9db2-4368-8c3f-4e723806faf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800d647bfa8a4109bd357f307ce103d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:21:17Z,use_quota=True,user_id='3bffd13855f44efdb234662e5428a1f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6744bebd-f26e-4f65-bfd2-edc0fdbd15b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6744bebd-f26e-4f65-bfd2-edc0fdbd15b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afec3fca-8628-4ef0-8332-e3d11be97f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afec3fca-8628-4ef0-8332-e3d11be97f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e496ad-9db2-4368-8c3f-4e723806faf3', 'volume_name': 'volume-a8e496ad-9db2-4368-8c3f-4e723806faf3', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda3077f-46c6-4a1c-b97a-81dd2f9de92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda3077f-46c6-4a1c-b97a-81dd2f9de92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185d5ac0-516d-4950-9cb1-430826947c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:17 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Volume a8e496ad-9db2-4368-8c3f-4e723806faf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e496ad-9db2-4368-8c3f-4e723806faf3', 'volume_size': 1} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:21:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-585497802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e496ad-9db2-4368-8c3f-4e723806faf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800d647bfa8a4109bd357f307ce103d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:21:17Z,use_quota=True,user_id='3bffd13855f44efdb234662e5428a1f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Creating volume a8e496ad-9db2-4368-8c3f-4e723806faf3 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:21:17 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-0bbd4e96-69ff-492a-bd04-4ed116f154de tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-2f474833-86e8-4fd5-bfd3-7539bc10b51a-delete_volume" released by "delete_volume" :: held 3.235s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:17 devstack sudo[110063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 1073741824 Jun 25 17:21:17 devstack sudo[110063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:18 devstack sudo[110063]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 1073741824" returned: 0 in 1.070s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:18 devstack sudo[110072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 Jun 25 17:21:18 devstack sudo[110072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:19 devstack sudo[110072]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3" returned: 0 in 0.736s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:19 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:21:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:19 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (185d5ac0-516d-4950-9cb1-430826947c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e496ad-9db2-4368-8c3f-4e723806faf3', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:19 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1683f278-299e-452c-8ef8-033f59ab496f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:19 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Volume volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 (a8e496ad-9db2-4368-8c3f-4e723806faf3): created successfully Jun 25 17:21:19 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1683f278-299e-452c-8ef8-033f59ab496f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:19 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Flow 'volume_create_manager' (bc17db2a-624c-47b7-8cff-cc0a8cc56687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:21:19 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-85e797a4-ad63-4fa9-8ca2-a0d1bb0c26f9 tempest-VolumesSnapshotTestJSON-2050396882 None] Created volume successfully. Jun 25 17:21:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a6ef472a-3b84-408f-a8b9-90b154764d92 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a6ef472a-3b84-408f-a8b9-90b154764d92 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a6ef472a-3b84-408f-a8b9-90b154764d92 tempest-VolumesSnapshotTestJSON-2050396882 None] Creating offline snapshot 206b6820-f6a2-4827-b63b-a9c8a465539c of volume a8e496ad-9db2-4368-8c3f-4e723806faf3 {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:21:20 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6eac5e8-fdd6-4980-a289-f38c2f50e927]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:21:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a6ef472a-3b84-408f-a8b9-90b154764d92 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:20 devstack sudo[110075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 Jun 25 17:21:20 devstack sudo[110075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:21 devstack sudo[110075]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a6ef472a-3b84-408f-a8b9-90b154764d92 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3" returned: 0 in 0.981s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a6ef472a-3b84-408f-a8b9-90b154764d92 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:21 devstack sudo[110081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c 1G Jun 25 17:21:21 devstack sudo[110081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:22 devstack sudo[110081]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a6ef472a-3b84-408f-a8b9-90b154764d92 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c 1G" returned: 0 in 1.010s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a6ef472a-3b84-408f-a8b9-90b154764d92 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:22 devstack sudo[110086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c Jun 25 17:21:22 devstack sudo[110086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:23 devstack sudo[110086]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a6ef472a-3b84-408f-a8b9-90b154764d92 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c" returned: 0 in 0.797s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:23 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-a6ef472a-3b84-408f-a8b9-90b154764d92 tempest-VolumesSnapshotTestJSON-2050396882 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c is being set with open permissions: ugo+rw Jun 25 17:21:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a6ef472a-3b84-408f-a8b9-90b154764d92 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:23 devstack sudo[110092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c Jun 25 17:21:23 devstack sudo[110092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:24 devstack sudo[110092]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a6ef472a-3b84-408f-a8b9-90b154764d92 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c" returned: 0 in 0.678s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a6ef472a-3b84-408f-a8b9-90b154764d92 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:24 devstack sudo[110095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.info Jun 25 17:21:24 devstack sudo[110095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:24 devstack sudo[110095]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a6ef472a-3b84-408f-a8b9-90b154764d92 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.info" returned: 0 in 0.716s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:24 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-a6ef472a-3b84-408f-a8b9-90b154764d92 tempest-VolumesSnapshotTestJSON-2050396882 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.info is being set with open permissions: ugo+rw Jun 25 17:21:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a6ef472a-3b84-408f-a8b9-90b154764d92 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:25 devstack sudo[110098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.info Jun 25 17:21:25 devstack sudo[110098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Flow 'volume_create_manager' (bfbac573-1329-4672-a5f6-b080de92b411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298ddecb-3351-40fb-9cc4-c0fe4b14667f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298ddecb-3351-40fb-9cc4-c0fe4b14667f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-430326828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4a9fbf-6dc9-499a-ac5c-6279b19f597e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8d0e1cbf024737a4ee1ea9d538634d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:21:25Z,use_quota=True,user_id='86cd13aaed7642f785ecedaae486ed08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d9a94f-da31-4f2f-ba88-c961f505307e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d9a94f-da31-4f2f-ba88-c961f505307e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4d1009-ac2d-4661-9a9d-429fb8b9d242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4d1009-ac2d-4661-9a9d-429fb8b9d242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e4a9fbf-6dc9-499a-ac5c-6279b19f597e', 'volume_name': 'volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a271b5bf-0065-46a2-8628-cea449e18cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a271b5bf-0065-46a2-8628-cea449e18cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ff33e8-4071-47a3-996a-d6ed45993f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:25 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Volume 3e4a9fbf-6dc9-499a-ac5c-6279b19f597e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e', 'volume_size': 1} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:25 devstack sudo[110098]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a6ef472a-3b84-408f-a8b9-90b154764d92 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.info" returned: 0 in 0.707s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a6ef472a-3b84-408f-a8b9-90b154764d92 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.014s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.438s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-430326828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4a9fbf-6dc9-499a-ac5c-6279b19f597e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8d0e1cbf024737a4ee1ea9d538634d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:21:25Z,use_quota=True,user_id='86cd13aaed7642f785ecedaae486ed08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Creating volume 3e4a9fbf-6dc9-499a-ac5c-6279b19f597e {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:21:25 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:21:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:25 devstack sudo[110101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e 1073741824 Jun 25 17:21:25 devstack sudo[110101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:25 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-a6ef472a-3b84-408f-a8b9-90b154764d92 tempest-VolumesSnapshotTestJSON-2050396882 None] Create snapshot completed successfully Jun 25 17:21:26 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:21:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Flow 'volume_create_manager' (579bef0c-e59a-4248-82cb-5dc169a6f281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:21:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90420f98-4b44-4f9d-8365-02777cf7e752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90420f98-4b44-4f9d-8365-02777cf7e752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1201460839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea79072-035c-4a6e-9542-072031f6b939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='800d647bfa8a4109bd357f307ce103d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=206b6820-f6a2-4827-b63b-a9c8a465539c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:21:27Z,use_quota=True,user_id='3bffd13855f44efdb234662e5428a1f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc95ae7-8af8-49e9-a92f-68d5eb1ac595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc95ae7-8af8-49e9-a92f-68d5eb1ac595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29cb54f2-8ff6-46b7-93db-f5f1f1eb6507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29cb54f2-8ff6-46b7-93db-f5f1f1eb6507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eea79072-035c-4a6e-9542-072031f6b939', 'volume_name': 'volume-eea79072-035c-4a6e-9542-072031f6b939', 'volume_size': 1, 'snapshot_id': '206b6820-f6a2-4827-b63b-a9c8a465539c'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2716fd-7528-448e-b309-d695b553870a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2716fd-7528-448e-b309-d695b553870a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65886428-73cf-4968-9b97-03098427143f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:26 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Volume eea79072-035c-4a6e-9542-072031f6b939: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eea79072-035c-4a6e-9542-072031f6b939', 'volume_size': 1, 'snapshot_id': '206b6820-f6a2-4827-b63b-a9c8a465539c'} Jun 25 17:21:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:26 devstack sudo[110101]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e 1073741824" returned: 0 in 1.087s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:26 devstack sudo[110107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e Jun 25 17:21:26 devstack sudo[110107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:27 devstack sudo[110107]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e" returned: 0 in 0.709s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.848s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-quobyte-206b6820-f6a2-4827-b63b-a9c8a465539c-eea79072-035c-4a6e-9542-072031f6b939" by "_create_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ff33e8-4071-47a3-996a-d6ed45993f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d40273-f517-4b6e-a2d5-801401150547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-206b6820-f6a2-4827-b63b-a9c8a465539c-eea79072-035c-4a6e-9542-072031f6b939" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Creating volume eea79072-035c-4a6e-9542-072031f6b939 from snapshot 206b6820-f6a2-4827-b63b-a9c8a465539c {{(pid=93869) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-quobyte-eea79072-035c-4a6e-9542-072031f6b939" by "_copy_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:27 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Volume volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e (3e4a9fbf-6dc9-499a-ac5c-6279b19f597e): created successfully Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d40273-f517-4b6e-a2d5-801401150547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Flow 'volume_create_manager' (bfbac573-1329-4672-a5f6-b080de92b411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-eea79072-035c-4a6e-9542-072031f6b939" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] snapshot: 206b6820-f6a2-4827-b63b-a9c8a465539c, volume: eea79072-035c-4a6e-9542-072031f6b939, {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 17:21:27 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-6180ca7c-0a28-43e8-a6a4-0e492a320295 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Created volume successfully. Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f23a577-abad-4fe3-b686-c92fe4abc4c5]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:21:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:27 devstack sudo[110111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c Jun 25 17:21:27 devstack sudo[110111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0397a4b3-61a1-4355-a748-f3e228e15128 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:28 devstack sudo[110111]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c" returned: 0 in 0.931s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8e496ad-9db2-4368-8c3f-4e723806faf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:21:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] will copy from snapshot at /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 17:21:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Creating direct copy from snapshot {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 17:21:28 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d62441d-32b4-4e6f-be74-bbb109a3ef11]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:21:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:28 devstack sudo[110116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 Jun 25 17:21:28 devstack sudo[110116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:29 devstack sudo[110116]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3" returned: 0 in 0.919s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:29 devstack cinder-volume[93869]: DEBUG cinder.utils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Path /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eea79072-035c-4a6e-9542-072031f6b939 not found in is_blk_device check {{(pid=93869) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 17:21:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eea79072-035c-4a6e-9542-072031f6b939 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:29 devstack sudo[110121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eea79072-035c-4a6e-9542-072031f6b939 Jun 25 17:21:29 devstack sudo[110121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:34 devstack sudo[110121]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eea79072-035c-4a6e-9542-072031f6b939" returned: 0 in 5.138s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:34 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6c6f26-e89f-4ad0-9d4f-eeeb173dd299]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:21:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:34 devstack sudo[110171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 Jun 25 17:21:34 devstack sudo[110171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:35 devstack sudo[110171]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3" returned: 0 in 1.055s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:35 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Image conversion details: src /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3, size 1024.00 MB, duration 5.14 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eea79072-035c-4a6e-9542-072031f6b939 {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:21:35 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Converted 1024.00 MB image at 199.24 MB/s Jun 25 17:21:35 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eea79072-035c-4a6e-9542-072031f6b939 is being set with open permissions: ugo+rw Jun 25 17:21:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eea79072-035c-4a6e-9542-072031f6b939 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:35 devstack sudo[110176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eea79072-035c-4a6e-9542-072031f6b939 Jun 25 17:21:35 devstack sudo[110176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:36 devstack sudo[110176]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eea79072-035c-4a6e-9542-072031f6b939" returned: 0 in 0.691s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:36 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-eea79072-035c-4a6e-9542-072031f6b939" released by "_copy_volume_from_snapshot" :: held 8.857s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:36 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-206b6820-f6a2-4827-b63b-a9c8a465539c-eea79072-035c-4a6e-9542-072031f6b939" released by "_create_volume_from_snapshot" :: held 8.906s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.951s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0397a4b3-61a1-4355-a748-f3e228e15128 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.961s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:36 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=72,cinder:UPDATE=73,cinder:INSERT=20,cinder:DELETE=7 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:21:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-0397a4b3-61a1-4355-a748-f3e228e15128 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Creating offline snapshot c1210ffd-5470-45aa-899d-46aca5ef07bb of volume 3e4a9fbf-6dc9-499a-ac5c-6279b19f597e {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:21:36 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65886428-73cf-4968-9b97-03098427143f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea79072-035c-4a6e-9542-072031f6b939', 'volume_size': 1, 'snapshot_id': '206b6820-f6a2-4827-b63b-a9c8a465539c'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:36 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4d5d82-0999-439b-a9d6-72a7859a85e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:36 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7943b2a1-a302-4d6f-a560-9faac62bbc42]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:21:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0397a4b3-61a1-4355-a748-f3e228e15128 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:36 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Volume volume-eea79072-035c-4a6e-9542-072031f6b939 (eea79072-035c-4a6e-9542-072031f6b939): created successfully Jun 25 17:21:36 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4d5d82-0999-439b-a9d6-72a7859a85e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:36 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Flow 'volume_create_manager' (579bef0c-e59a-4248-82cb-5dc169a6f281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:21:36 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-e8660305-a68f-4db1-a7fc-e3edeeb08284 tempest-VolumesSnapshotTestJSON-2050396882 None] Created volume successfully. Jun 25 17:21:36 devstack sudo[110179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e Jun 25 17:21:36 devstack sudo[110179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:37 devstack sudo[110179]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0397a4b3-61a1-4355-a748-f3e228e15128 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e" returned: 0 in 1.035s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0397a4b3-61a1-4355-a748-f3e228e15128 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:37 devstack sudo[110184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb 1G Jun 25 17:21:37 devstack sudo[110184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:37 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-eea79072-035c-4a6e-9542-072031f6b939-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:37 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-eea79072-035c-4a6e-9542-072031f6b939-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:37 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-quobyte-eea79072-035c-4a6e-9542-072031f6b939" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:37 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-eea79072-035c-4a6e-9542-072031f6b939" acquired by "delete_volume" :: waited 0.016s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:37 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d85b65-b829-4f7f-a06b-8bcb229cbfe6]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:21:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eea79072-035c-4a6e-9542-072031f6b939 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:38 devstack sudo[110186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eea79072-035c-4a6e-9542-072031f6b939 Jun 25 17:21:38 devstack sudo[110186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:38 devstack sudo[110184]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0397a4b3-61a1-4355-a748-f3e228e15128 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb 1G" returned: 0 in 1.042s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0397a4b3-61a1-4355-a748-f3e228e15128 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:38 devstack sudo[110194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb Jun 25 17:21:38 devstack sudo[110194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:38 devstack sudo[110186]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eea79072-035c-4a6e-9542-072031f6b939" returned: 0 in 0.911s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eea79072-035c-4a6e-9542-072031f6b939 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:38 devstack sudo[110196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eea79072-035c-4a6e-9542-072031f6b939 Jun 25 17:21:38 devstack sudo[110196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:39 devstack sudo[110194]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0397a4b3-61a1-4355-a748-f3e228e15128 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb" returned: 0 in 0.819s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:39 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-0397a4b3-61a1-4355-a748-f3e228e15128 tempest-CreateVolumesFromSnapshotTest-1762574136 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb is being set with open permissions: ugo+rw Jun 25 17:21:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0397a4b3-61a1-4355-a748-f3e228e15128 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:39 devstack sudo[110202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb Jun 25 17:21:39 devstack sudo[110202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:39 devstack sudo[110196]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-eea79072-035c-4a6e-9542-072031f6b939" returned: 0 in 0.795s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:39 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-eea79072-035c-4a6e-9542-072031f6b939" released by "delete_volume" :: held 1.759s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:39 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] Created reservations ['61158f34-8993-4423-b3f0-f9383427703e', 'c36ffa2d-6671-4a9d-914d-3a50f4aec335', '19687db8-2edd-4f48-ac81-7e3c0da0b46e', '63501006-1919-4ec1-8c4a-3ea47ecd3dd0'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:21:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:21:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:21:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:39 devstack sudo[110204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:21:39 devstack sudo[110204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:40 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-206b6820-f6a2-4827-b63b-a9c8a465539c-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:40 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-206b6820-f6a2-4827-b63b-a9c8a465539c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:40 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-quobyte-a8e496ad-9db2-4368-8c3f-4e723806faf3" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:40 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-a8e496ad-9db2-4368-8c3f-4e723806faf3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:40 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-quobyte-206b6820-f6a2-4827-b63b-a9c8a465539c" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:40 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-206b6820-f6a2-4827-b63b-a9c8a465539c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:40 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] Deleting offline snapshot 206b6820-f6a2-4827-b63b-a9c8a465539c of volume a8e496ad-9db2-4368-8c3f-4e723806faf3 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:21:40 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] snapshot_file for this snap is: volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:21:40 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f704158-a67d-451c-afe9-1bbbd4bea4fb]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:21:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:40 devstack sudo[110202]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0397a4b3-61a1-4355-a748-f3e228e15128 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb" returned: 0 in 0.837s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0397a4b3-61a1-4355-a748-f3e228e15128 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:40 devstack sudo[110208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.info Jun 25 17:21:40 devstack sudo[110208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:40 devstack sudo[110207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c Jun 25 17:21:40 devstack sudo[110207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:40 devstack sudo[110204]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.729s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:40 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:21:40 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] Deleted volume successfully. Jun 25 17:21:40 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-bfe2f5fb-d639-4002-bf55-a7946bbe940c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-eea79072-035c-4a6e-9542-072031f6b939-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:41 devstack sudo[110208]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0397a4b3-61a1-4355-a748-f3e228e15128 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.info" returned: 0 in 0.768s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:41 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-0397a4b3-61a1-4355-a748-f3e228e15128 tempest-CreateVolumesFromSnapshotTest-1762574136 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.info is being set with open permissions: ugo+rw Jun 25 17:21:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0397a4b3-61a1-4355-a748-f3e228e15128 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:41 devstack sudo[110216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.info Jun 25 17:21:41 devstack sudo[110216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:41 devstack sudo[110207]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c" returned: 0 in 1.003s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8e496ad-9db2-4368-8c3f-4e723806faf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:21:41 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdd1fc6-b9a5-4e32-a446-f571421dec83]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:21:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:41 devstack sudo[110218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 Jun 25 17:21:41 devstack sudo[110218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:41 devstack sudo[110216]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0397a4b3-61a1-4355-a748-f3e228e15128 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.info" returned: 0 in 0.835s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0397a4b3-61a1-4355-a748-f3e228e15128 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.458s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:42 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-0397a4b3-61a1-4355-a748-f3e228e15128 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Create snapshot completed successfully Jun 25 17:21:42 devstack sudo[110218]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3" returned: 0 in 0.963s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:42 devstack sudo[110224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c Jun 25 17:21:42 devstack sudo[110224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:42 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:21:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Flow 'volume_create_manager' (0c7ed980-efb6-49d5-9e7c-eed704dcab55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:21:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914d8e8e-c237-469a-9f94-af0aeb0b49e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914d8e8e-c237-469a-9f94-af0aeb0b49e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1698679208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfca12d4-3bb5-4217-83dd-4c01814929cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8d0e1cbf024737a4ee1ea9d538634d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:21:43Z,use_quota=True,user_id='86cd13aaed7642f785ecedaae486ed08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e11659-5872-4d69-9522-ee82f9b2a63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e11659-5872-4d69-9522-ee82f9b2a63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7546f954-6da1-4500-8f29-4bf688d9f681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7546f954-6da1-4500-8f29-4bf688d9f681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfca12d4-3bb5-4217-83dd-4c01814929cf', 'volume_name': 'volume-bfca12d4-3bb5-4217-83dd-4c01814929cf', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36980e75-d27c-4810-b499-3fa611a6061c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36980e75-d27c-4810-b499-3fa611a6061c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c793409-b136-42ee-9f76-e066443c60b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:43 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Volume bfca12d4-3bb5-4217-83dd-4c01814929cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfca12d4-3bb5-4217-83dd-4c01814929cf', 'volume_size': 1} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1698679208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfca12d4-3bb5-4217-83dd-4c01814929cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8d0e1cbf024737a4ee1ea9d538634d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:21:43Z,use_quota=True,user_id='86cd13aaed7642f785ecedaae486ed08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Creating volume bfca12d4-3bb5-4217-83dd-4c01814929cf {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:21:43 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bfca12d4-3bb5-4217-83dd-4c01814929cf 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:43 devstack sudo[110229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bfca12d4-3bb5-4217-83dd-4c01814929cf 1073741824 Jun 25 17:21:43 devstack sudo[110229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:43 devstack sudo[110224]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c" returned: 0 in 0.882s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:43 devstack sudo[110231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c Jun 25 17:21:43 devstack sudo[110231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Flow 'volume_create_manager' (6942abac-0d7e-4c44-b47a-f2f6e51d3bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc270481-919e-4451-8042-e435e7350ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc270481-919e-4451-8042-e435e7350ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1782270190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03f3897-53d7-480f-b9d0-ebc161d6646d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8d0e1cbf024737a4ee1ea9d538634d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:21:43Z,use_quota=True,user_id='86cd13aaed7642f785ecedaae486ed08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc42d6e-85f5-4a0f-a0d7-cdc3c7a490bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc42d6e-85f5-4a0f-a0d7-cdc3c7a490bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed387165-673c-49db-90ea-0359961d2c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed387165-673c-49db-90ea-0359961d2c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03f3897-53d7-480f-b9d0-ebc161d6646d', 'volume_name': 'volume-f03f3897-53d7-480f-b9d0-ebc161d6646d', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6b624a-9a0f-41d8-8e09-90e405e9b4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6b624a-9a0f-41d8-8e09-90e405e9b4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aaf8797-aa65-45c4-a6ef-56640c945e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:43 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Volume f03f3897-53d7-480f-b9d0-ebc161d6646d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03f3897-53d7-480f-b9d0-ebc161d6646d', 'volume_size': 1} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:43 devstack sudo[110231]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3.206b6820-f6a2-4827-b63b-a9c8a465539c" returned: 0 in 0.775s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Flow 'volume_create_manager' (9c70337a-dd36-408e-9e3c-6482de9264e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f498a10e-48e2-487d-8000-2ac6a442d211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:43 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-206b6820-f6a2-4827-b63b-a9c8a465539c" released by "_delete_snapshot" :: held 3.821s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-a8e496ad-9db2-4368-8c3f-4e723806faf3" released by "delete_snapshot" :: held 3.862s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f498a10e-48e2-487d-8000-2ac6a442d211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1837219202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41b55ec-cad1-4f54-8c1c-83ce3ad77205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8d0e1cbf024737a4ee1ea9d538634d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:21:44Z,use_quota=True,user_id='86cd13aaed7642f785ecedaae486ed08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5846c7-40bf-43f1-beb3-8d0c37ff0f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5846c7-40bf-43f1-beb3-8d0c37ff0f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25fa1c6a-5ad8-49b4-9350-44a17ae4578f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25fa1c6a-5ad8-49b4-9350-44a17ae4578f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c41b55ec-cad1-4f54-8c1c-83ce3ad77205', 'volume_name': 'volume-c41b55ec-cad1-4f54-8c1c-83ce3ad77205', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e4ae64-80f0-4a2c-8101-e1316b9a85db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23e4ae64-80f0-4a2c-8101-e1316b9a85db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0fc56e-ca36-4e26-8a4f-2c9f540ed3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:44 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Volume c41b55ec-cad1-4f54-8c1c-83ce3ad77205: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c41b55ec-cad1-4f54-8c1c-83ce3ad77205', 'volume_size': 1} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] Created reservations ['3ed7dbd8-7a0e-4614-acb1-ccc33c2b7c29', 'f332185a-b8c9-4089-a6e6-94ded57e6f6b', '61a4683b-a298-4333-87bb-f2e4048e86c9', 'f4c5955b-1794-4464-8fcb-c81c7845a06b'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:21:44 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] Delete snapshot completed successfully. Jun 25 17:21:44 devstack sudo[110229]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bfca12d4-3bb5-4217-83dd-4c01814929cf 1073741824" returned: 0 in 1.200s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-d3865409-4849-4f27-b315-0ca792c8f2e2 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-206b6820-f6a2-4827-b63b-a9c8a465539c-delete_snapshot" released by "delete_snapshot" :: held 4.106s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:44 devstack sudo[110239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:21:44 devstack sudo[110239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bfca12d4-3bb5-4217-83dd-4c01814929cf {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:21:44 devstack sudo[110241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bfca12d4-3bb5-4217-83dd-4c01814929cf Jun 25 17:21:44 devstack sudo[110241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Flow 'volume_create_manager' (2ac5ebee-e6d8-4904-a45c-ec155adde94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21657a87-4dfb-48cf-ba2c-3be2ed0b403b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-a8e496ad-9db2-4368-8c3f-4e723806faf3-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21657a87-4dfb-48cf-ba2c-3be2ed0b403b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-333109320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536626a5-cfb6-4c22-a0f2-b37e9bb00ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8d0e1cbf024737a4ee1ea9d538634d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:21:44Z,use_quota=True,user_id='86cd13aaed7642f785ecedaae486ed08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af6fe19-6513-4600-a53a-54a07a08dc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af6fe19-6513-4600-a53a-54a07a08dc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15cede1-65a4-4696-a842-763838b40c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e15cede1-65a4-4696-a842-763838b40c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '536626a5-cfb6-4c22-a0f2-b37e9bb00ef7', 'volume_name': 'volume-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad69bcae-46af-46b6-a6ac-1203e732625b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad69bcae-46af-46b6-a6ac-1203e732625b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca1a84b-1444-43b3-8f48-99642243f6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:44 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Volume 536626a5-cfb6-4c22-a0f2-b37e9bb00ef7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7', 'volume_size': 1} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-a8e496ad-9db2-4368-8c3f-4e723806faf3-delete_volume" acquired by "delete_volume" :: waited 0.129s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-quobyte-a8e496ad-9db2-4368-8c3f-4e723806faf3" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-a8e496ad-9db2-4368-8c3f-4e723806faf3" acquired by "delete_volume" :: waited 0.027s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b6257f-bea9-4186-88d7-f319e21e4ae4]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:21:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:44 devstack sudo[110243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 Jun 25 17:21:44 devstack sudo[110243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Flow 'volume_create_manager' (e88da3a8-a3fd-4361-ba1d-2540e5d536a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15678ab6-3038-4ccd-a7c5-3c9043a97cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15678ab6-3038-4ccd-a7c5-3c9043a97cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-552144264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8d0e1cbf024737a4ee1ea9d538634d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:21:45Z,use_quota=True,user_id='86cd13aaed7642f785ecedaae486ed08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3fd76a-bc91-4e6f-9d5c-95f58eaec954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f3fd76a-bc91-4e6f-9d5c-95f58eaec954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eeb58ae-a187-49f4-ade2-69b5a73bf6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eeb58ae-a187-49f4-ade2-69b5a73bf6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69', 'volume_name': 'volume-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6321fa7c-3648-43bb-96de-79a073f736ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6321fa7c-3648-43bb-96de-79a073f736ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a866cd-d544-4d1c-a25a-c3e34d8dc1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:45 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Volume 4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69', 'volume_size': 1} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:45 devstack sudo[110239]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.977s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 28 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:21:45 devstack sudo[110241]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bfca12d4-3bb5-4217-83dd-4c01814929cf" returned: 0 in 0.896s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] <== create_volume: return (2235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.238s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.723s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1782270190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03f3897-53d7-480f-b9d0-ebc161d6646d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8d0e1cbf024737a4ee1ea9d538634d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:21:43Z,use_quota=True,user_id='86cd13aaed7642f785ecedaae486ed08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Creating volume f03f3897-53d7-480f-b9d0-ebc161d6646d {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:21:45 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f03f3897-53d7-480f-b9d0-ebc161d6646d 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c793409-b136-42ee-9f76-e066443c60b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfca12d4-3bb5-4217-83dd-4c01814929cf', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:45 devstack sudo[110247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f03f3897-53d7-480f-b9d0-ebc161d6646d 1073741824 Jun 25 17:21:45 devstack sudo[110247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827bfcc8-49d3-489e-a1ff-1006ad2f7630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:45 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Volume volume-bfca12d4-3bb5-4217-83dd-4c01814929cf (bfca12d4-3bb5-4217-83dd-4c01814929cf): created successfully Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (827bfcc8-49d3-489e-a1ff-1006ad2f7630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Flow 'volume_create_manager' (0c7ed980-efb6-49d5-9e7c-eed704dcab55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:21:45 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-71095886-86eb-4649-a936-8fe1d543290d tempest-CreateVolumesFromSnapshotTest-1762574136 None] Created volume successfully. Jun 25 17:21:45 devstack sudo[110243]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3" returned: 0 in 0.921s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:45 devstack sudo[110252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3 Jun 25 17:21:45 devstack sudo[110252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:46 devstack sudo[110247]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f03f3897-53d7-480f-b9d0-ebc161d6646d 1073741824" returned: 0 in 0.965s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f03f3897-53d7-480f-b9d0-ebc161d6646d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:46 devstack sudo[110258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f03f3897-53d7-480f-b9d0-ebc161d6646d Jun 25 17:21:46 devstack sudo[110258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:46 devstack sudo[110252]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-a8e496ad-9db2-4368-8c3f-4e723806faf3" returned: 0 in 0.687s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:46 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-a8e496ad-9db2-4368-8c3f-4e723806faf3" released by "delete_volume" :: held 1.703s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:46 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] Created reservations ['9c1a13cc-1788-4ba9-b30f-12f4e4ce16d7', '0aa9e018-404b-4eb7-aafe-eabe68d0a732', 'e37e00fd-5437-4642-a38a-e58b44f178bd', '93fbc112-12a1-4f6b-a159-bbf26bf5f95b'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:21:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:21:46 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:21:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:46 devstack sudo[110260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:21:46 devstack sudo[110260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:46 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-dc71e3da-2882-43b1-9bf2-2a84ffa08546-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:46 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-dc71e3da-2882-43b1-9bf2-2a84ffa08546-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:46 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "cinder-quobyte-dc71e3da-2882-43b1-9bf2-2a84ffa08546" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:46 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-dc71e3da-2882-43b1-9bf2-2a84ffa08546" acquired by "delete_volume" :: waited 0.017s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:46 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d6060f-bf98-4a5a-ae3c-ae52897938ee]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:21:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:47 devstack sudo[110258]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f03f3897-53d7-480f-b9d0-ebc161d6646d" returned: 0 in 0.755s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.958s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1837219202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c41b55ec-cad1-4f54-8c1c-83ce3ad77205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8d0e1cbf024737a4ee1ea9d538634d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:21:44Z,use_quota=True,user_id='86cd13aaed7642f785ecedaae486ed08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Creating volume c41b55ec-cad1-4f54-8c1c-83ce3ad77205 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:21:47 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c41b55ec-cad1-4f54-8c1c-83ce3ad77205 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:47 devstack sudo[110264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c41b55ec-cad1-4f54-8c1c-83ce3ad77205 1073741824 Jun 25 17:21:47 devstack sudo[110264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aaf8797-aa65-45c4-a6ef-56640c945e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03f3897-53d7-480f-b9d0-ebc161d6646d', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa6875f-6329-4c8a-b514-308615a9643c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:47 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Volume volume-f03f3897-53d7-480f-b9d0-ebc161d6646d (f03f3897-53d7-480f-b9d0-ebc161d6646d): created successfully Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa6875f-6329-4c8a-b514-308615a9643c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Flow 'volume_create_manager' (6942abac-0d7e-4c44-b47a-f2f6e51d3bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:21:47 devstack sudo[110263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546 Jun 25 17:21:47 devstack sudo[110263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:47 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-828845a8-c27b-4ac6-864f-3a9763bf1952 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Created volume successfully. Jun 25 17:21:47 devstack sudo[110260]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.740s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:21:47 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] Deleted volume successfully. Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=69,cinder:INSERT=19,cinder:UPDATE=75,cinder:DELETE=7 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b57410da-25c7-4834-8abc-2c2c8fee1b1c tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-a8e496ad-9db2-4368-8c3f-4e723806faf3-delete_volume" released by "delete_volume" :: held 2.672s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:47 devstack sudo[110263]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546" returned: 0 in 0.870s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:47 devstack sudo[110275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546 Jun 25 17:21:47 devstack sudo[110275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:47 devstack sudo[110264]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c41b55ec-cad1-4f54-8c1c-83ce3ad77205 1073741824" returned: 0 in 0.946s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c41b55ec-cad1-4f54-8c1c-83ce3ad77205 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:48 devstack sudo[110277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c41b55ec-cad1-4f54-8c1c-83ce3ad77205 Jun 25 17:21:48 devstack sudo[110277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:48 devstack sudo[110275]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-dc71e3da-2882-43b1-9bf2-2a84ffa08546" returned: 0 in 0.707s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-quobyte-dc71e3da-2882-43b1-9bf2-2a84ffa08546" released by "delete_volume" :: held 1.657s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] Created reservations ['e7b11c3b-f521-44f1-a37e-2c36d2717141', '7afa8dba-d3b8-4396-85e7-94de3675656e', '834951eb-aef0-4a30-91fe-6f806531d380', 'f5b172cc-0fa2-4beb-9569-d78252d91874'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:21:48 devstack sudo[110277]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c41b55ec-cad1-4f54-8c1c-83ce3ad77205" returned: 0 in 0.657s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.061s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-333109320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536626a5-cfb6-4c22-a0f2-b37e9bb00ef7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8d0e1cbf024737a4ee1ea9d538634d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:21:44Z,use_quota=True,user_id='86cd13aaed7642f785ecedaae486ed08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Creating volume 536626a5-cfb6-4c22-a0f2-b37e9bb00ef7 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:21:48 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0fc56e-ca36-4e26-8a4f-2c9f540ed3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c41b55ec-cad1-4f54-8c1c-83ce3ad77205', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:48 devstack sudo[110281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7 1073741824 Jun 25 17:21:48 devstack sudo[110281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b2b73a-2608-4039-a07d-48facfbe75f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:48 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Volume volume-c41b55ec-cad1-4f54-8c1c-83ce3ad77205 (c41b55ec-cad1-4f54-8c1c-83ce3ad77205): created successfully Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b2b73a-2608-4039-a07d-48facfbe75f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Flow 'volume_create_manager' (9c70337a-dd36-408e-9e3c-6482de9264e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:21:48 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-654cc092-c773-4bce-8375-fd3fb4965129 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Created volume successfully. Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:48 devstack sudo[110283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:21:48 devstack sudo[110283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:49 devstack sudo[110283]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.723s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:49 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:21:49 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] Deleted volume successfully. Jun 25 17:21:49 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-af8b8724-12c6-492b-ab66-8ce6d2f615d1 tempest-VolumesSnapshotTestJSON-2050396882 None] Lock "cinder-dc71e3da-2882-43b1-9bf2-2a84ffa08546-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:49 devstack sudo[110281]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7 1073741824" returned: 0 in 0.956s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:49 devstack sudo[110291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7 Jun 25 17:21:49 devstack sudo[110291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:50 devstack sudo[110291]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7" returned: 0 in 0.721s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:21:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.205s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:21:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-552144264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8d0e1cbf024737a4ee1ea9d538634d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:21:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:21:45Z,use_quota=True,user_id='86cd13aaed7642f785ecedaae486ed08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:21:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Creating volume 4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:21:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:21:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:21:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:21:50 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:21:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:50 devstack sudo[110295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69 1073741824 Jun 25 17:21:50 devstack sudo[110295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bca1a84b-1444-43b3-8f48-99642243f6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29beb66-5747-4561-92e3-aba469b3ed35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:50 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Volume volume-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7 (536626a5-cfb6-4c22-a0f2-b37e9bb00ef7): created successfully Jun 25 17:21:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29beb66-5747-4561-92e3-aba469b3ed35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Flow 'volume_create_manager' (2ac5ebee-e6d8-4904-a45c-ec155adde94e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:21:50 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b65159ad-9081-48ea-ab9f-8b0c1308bdf5 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Created volume successfully. Jun 25 17:21:51 devstack sudo[110295]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69 1073741824" returned: 0 in 0.949s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:51 devstack sudo[110302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69 Jun 25 17:21:51 devstack sudo[110302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:52 devstack sudo[110302]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69" returned: 0 in 0.730s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:21:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a866cd-d544-4d1c-a25a-c3e34d8dc1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d03220e3-826a-4d1f-847e-59120fce9a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:21:52 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Volume volume-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69 (4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69): created successfully Jun 25 17:21:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d03220e3-826a-4d1f-847e-59120fce9a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:21:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Flow 'volume_create_manager' (e88da3a8-a3fd-4361-ba1d-2540e5d536a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:21:52 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-0c8435c5-9187-4139-94e3-ed6e3d27f237 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Created volume successfully. Jun 25 17:21:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "cinder-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "cinder-quobyte-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-quobyte-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69" acquired by "delete_volume" :: waited 0.021s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:52 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d05b762-b526-47f1-8ec3-83682eabe998]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:21:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:53 devstack sudo[110305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69 Jun 25 17:21:53 devstack sudo[110305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:53 devstack sudo[110305]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69" returned: 0 in 0.915s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:53 devstack sudo[110312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69 Jun 25 17:21:53 devstack sudo[110312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:54 devstack sudo[110312]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69" returned: 0 in 0.725s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:54 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-quobyte-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69" released by "delete_volume" :: held 1.690s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:54 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Created reservations ['da268d58-aa95-430c-8f22-f4f82e4b43be', 'd7907436-20e9-4ff2-b206-9996028311d2', '8b97f2ef-6f3e-44e8-bf22-b72860228cc3', '032cfac2-d811-4913-a8c6-959375c46091'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:21:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:21:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:21:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:54 devstack sudo[110315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:21:54 devstack sudo[110315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:55 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "cinder-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:55 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:55 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "cinder-quobyte-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:55 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-quobyte-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7" acquired by "delete_volume" :: waited 0.016s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:55 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[270eead0-c667-40dd-b6d8-33ecce5fe044]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:21:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:55 devstack sudo[110319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7 Jun 25 17:21:55 devstack sudo[110319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:55 devstack sudo[110315]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.824s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:55 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:21:55 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Deleted volume successfully. Jun 25 17:21:55 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eeecca86-8dc7-47fa-81e2-556d4a057474 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-4bbaee23-2bb5-4ccb-a6df-34ecc0cacb69-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:56 devstack sudo[110319]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7" returned: 0 in 0.948s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:56 devstack sudo[110325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7 Jun 25 17:21:56 devstack sudo[110325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:57 devstack sudo[110325]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7" returned: 0 in 0.804s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-quobyte-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7" released by "delete_volume" :: held 1.805s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:57 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] Created reservations ['7fba3187-b2f2-4aa5-987c-2fa6b347a414', '36492211-4f38-44f4-8d07-a61cb7ceec98', 'bc29dea7-584a-4b80-b782-280c14e4a28e', '4a7b580b-6350-4a0c-b5ee-a2fbd66a0428'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:21:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:57 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:21:57 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:21:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:57 devstack sudo[110328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:21:57 devstack sudo[110328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "cinder-c41b55ec-cad1-4f54-8c1c-83ce3ad77205-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-c41b55ec-cad1-4f54-8c1c-83ce3ad77205-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "cinder-quobyte-c41b55ec-cad1-4f54-8c1c-83ce3ad77205" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-quobyte-c41b55ec-cad1-4f54-8c1c-83ce3ad77205" acquired by "delete_volume" :: waited 0.022s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:57 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5c471b-b127-426b-ad47-299419270b8e]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:21:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c41b55ec-cad1-4f54-8c1c-83ce3ad77205 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:57 devstack sudo[110330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c41b55ec-cad1-4f54-8c1c-83ce3ad77205 Jun 25 17:21:57 devstack sudo[110330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:58 devstack sudo[110328]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.071s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:58 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:21:58 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] Deleted volume successfully. Jun 25 17:21:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a2f05023-6c92-4dfa-b2eb-187dd159e0ee tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-536626a5-cfb6-4c22-a0f2-b37e9bb00ef7-delete_volume" released by "delete_volume" :: held 3.329s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:58 devstack sudo[110330]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c41b55ec-cad1-4f54-8c1c-83ce3ad77205" returned: 0 in 1.056s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c41b55ec-cad1-4f54-8c1c-83ce3ad77205 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:58 devstack sudo[110342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c41b55ec-cad1-4f54-8c1c-83ce3ad77205 Jun 25 17:21:58 devstack sudo[110342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:59 devstack sudo[110342]: pam_unix(sudo:session): session closed for user root Jun 25 17:21:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c41b55ec-cad1-4f54-8c1c-83ce3ad77205" returned: 0 in 0.798s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:21:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-quobyte-c41b55ec-cad1-4f54-8c1c-83ce3ad77205" released by "delete_volume" :: held 1.915s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:21:59 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Created reservations ['8cc8d04f-52b8-4f1a-a4d5-cb6841f6ef4b', '85904895-7c6c-4cbf-bbe9-d3379e7ad59f', '433f49a8-70b3-422c-addf-4de77b5cd9f6', '2aa92d6e-ac76-48a0-91d8-ea918cb3d64c'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:21:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:21:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:21:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:21:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:21:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:21:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:21:59 devstack sudo[110345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:21:59 devstack sudo[110345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:21:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "cinder-f03f3897-53d7-480f-b9d0-ebc161d6646d-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-f03f3897-53d7-480f-b9d0-ebc161d6646d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "cinder-quobyte-f03f3897-53d7-480f-b9d0-ebc161d6646d" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:21:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-quobyte-f03f3897-53d7-480f-b9d0-ebc161d6646d" acquired by "delete_volume" :: waited 0.016s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:21:59 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac822b71-d376-4c9e-9fc6-02f7910cc2f7]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:21:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f03f3897-53d7-480f-b9d0-ebc161d6646d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:00 devstack sudo[110347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f03f3897-53d7-480f-b9d0-ebc161d6646d Jun 25 17:22:00 devstack sudo[110347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:00 devstack sudo[110345]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.816s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:00 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:22:00 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Deleted volume successfully. Jun 25 17:22:00 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7386550b-14a5-445f-9c34-96ac5cedd104 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-c41b55ec-cad1-4f54-8c1c-83ce3ad77205-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:22:00 devstack sudo[110347]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f03f3897-53d7-480f-b9d0-ebc161d6646d" returned: 0 in 0.885s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f03f3897-53d7-480f-b9d0-ebc161d6646d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:00 devstack sudo[110354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f03f3897-53d7-480f-b9d0-ebc161d6646d Jun 25 17:22:00 devstack sudo[110354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:01 devstack sudo[110354]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f03f3897-53d7-480f-b9d0-ebc161d6646d" returned: 0 in 0.773s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-quobyte-f03f3897-53d7-480f-b9d0-ebc161d6646d" released by "delete_volume" :: held 1.720s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:22:01 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Created reservations ['d923e369-9a9e-4846-99b9-8b5595b8abb4', '96dc67fb-13a2-4bce-9f13-6bffda731a09', 'd54fe04c-8b08-4652-b302-a57b88c5ad75', 'cbfc6751-ac70-4e98-89c2-8bcbb464bb42'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:22:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:22:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:22:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:22:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:22:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:22:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:01 devstack sudo[110357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:22:01 devstack sudo[110357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "cinder-bfca12d4-3bb5-4217-83dd-4c01814929cf-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:22:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-bfca12d4-3bb5-4217-83dd-4c01814929cf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:22:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "cinder-quobyte-bfca12d4-3bb5-4217-83dd-4c01814929cf" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:22:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-quobyte-bfca12d4-3bb5-4217-83dd-4c01814929cf" acquired by "delete_volume" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:22:02 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b292abd-d8db-4cc9-b478-5109934e789f]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:22:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bfca12d4-3bb5-4217-83dd-4c01814929cf {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:02 devstack sudo[110359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bfca12d4-3bb5-4217-83dd-4c01814929cf Jun 25 17:22:02 devstack sudo[110359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:02 devstack sudo[110357]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.912s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:02 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:22:02 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Deleted volume successfully. Jun 25 17:22:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-65c7bfea-2742-40da-ad32-845a9468d194 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-f03f3897-53d7-480f-b9d0-ebc161d6646d-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:22:03 devstack sudo[110359]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bfca12d4-3bb5-4217-83dd-4c01814929cf" returned: 0 in 1.042s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bfca12d4-3bb5-4217-83dd-4c01814929cf {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:03 devstack sudo[110366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bfca12d4-3bb5-4217-83dd-4c01814929cf Jun 25 17:22:03 devstack sudo[110366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:04 devstack sudo[110366]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bfca12d4-3bb5-4217-83dd-4c01814929cf" returned: 0 in 0.794s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-quobyte-bfca12d4-3bb5-4217-83dd-4c01814929cf" released by "delete_volume" :: held 1.902s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:22:04 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Created reservations ['8d5ed445-61cb-4a3b-bd06-13b7cb31dad2', '181bfbad-69a7-4319-9f1f-43ef38f9bd80', 'b5dbf865-aba2-479f-8fdb-683bf0ff9dd7', 'c0e0c9d3-d3fc-4043-a7d1-5ee4ad10e3c8'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:22:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:22:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:22:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:22:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:22:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:22:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:04 devstack sudo[110370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:22:04 devstack sudo[110370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "cinder-c1210ffd-5470-45aa-899d-46aca5ef07bb-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:22:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-c1210ffd-5470-45aa-899d-46aca5ef07bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:22:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "cinder-quobyte-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:22:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-quobyte-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e" acquired by "delete_snapshot" :: waited 0.053s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:22:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "cinder-quobyte-c1210ffd-5470-45aa-899d-46aca5ef07bb" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:22:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-quobyte-c1210ffd-5470-45aa-899d-46aca5ef07bb" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:22:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Deleting offline snapshot c1210ffd-5470-45aa-899d-46aca5ef07bb of volume 3e4a9fbf-6dc9-499a-ac5c-6279b19f597e {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:22:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] snapshot_file for this snap is: volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:22:04 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[76938e48-94d5-4625-9729-ab9ec54a9ee8]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:22:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:04 devstack sudo[110372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb Jun 25 17:22:04 devstack sudo[110372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:05 devstack sudo[110370]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.990s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:05 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:22:05 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Deleted volume successfully. Jun 25 17:22:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a692d37b-4a96-4884-90ee-d70f55ffc887 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-bfca12d4-3bb5-4217-83dd-4c01814929cf-delete_volume" released by "delete_volume" :: held 3.194s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:22:05 devstack sudo[110372]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb" returned: 0 in 1.245s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:22:05 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba27cc90-350b-45ee-aa47-a8c6a5154cf2]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:22:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:06 devstack sudo[110380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e Jun 25 17:22:06 devstack sudo[110380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:06 devstack sudo[110380]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e" returned: 0 in 0.974s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:06 devstack sudo[110385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb Jun 25 17:22:06 devstack sudo[110385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:07 devstack sudo[110385]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb" returned: 0 in 1.019s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:08 devstack sudo[110391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb Jun 25 17:22:08 devstack sudo[110391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:08 devstack sudo[110391]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e.c1210ffd-5470-45aa-899d-46aca5ef07bb" returned: 0 in 0.863s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:08 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-quobyte-c1210ffd-5470-45aa-899d-46aca5ef07bb" released by "_delete_snapshot" :: held 4.256s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:22:08 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-quobyte-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e" released by "delete_snapshot" :: held 4.288s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:22:08 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Created reservations ['06323ff8-024b-4581-9882-6e220582468a', '1947ab37-c476-4f2c-8e66-6af21fc4b44a', '7a08e20e-bd17-4bd5-abbb-0ec829ceecbb', 'bf6d16c9-453c-4250-853f-42bd24748ab9'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:22:09 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Delete snapshot completed successfully. Jun 25 17:22:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-a23fa288-e205-41a9-9f54-511728576b51 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-c1210ffd-5470-45aa-899d-46aca5ef07bb-delete_snapshot" released by "delete_snapshot" :: held 4.504s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:22:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "cinder-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:22:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:22:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "cinder-quobyte-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:22:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-quobyte-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e" acquired by "delete_volume" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:22:10 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b679f6-a53c-4938-8c67-b0ca54cdbe63]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:22:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:10 devstack sudo[110395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e Jun 25 17:22:10 devstack sudo[110395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:11 devstack sudo[110395]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e" returned: 0 in 0.943s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:11 devstack sudo[110400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e Jun 25 17:22:11 devstack sudo[110400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:11 devstack sudo[110400]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e" returned: 0 in 0.679s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-quobyte-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e" released by "delete_volume" :: held 1.692s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:22:11 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Created reservations ['f2935387-a9fd-430c-9e23-8b5a61426812', '7d9507b3-06bd-4880-a1c6-2ce591f9e2f3', '174ccfb1-cb00-4446-9be5-038b171ce60c', '859c5ad6-d0e0-4f94-8c2f-e091dab549ee'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:22:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:22:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:22:11 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:22:11 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:22:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:22:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:11 devstack sudo[110403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:22:11 devstack sudo[110403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:12 devstack sudo[110403]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.860s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:12 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:22:12 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Deleted volume successfully. Jun 25 17:22:12 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-12be79c6-977b-44f5-a941-4507bbf5c690 tempest-CreateVolumesFromSnapshotTest-1762574136 None] Lock "cinder-3e4a9fbf-6dc9-499a-ac5c-6279b19f597e-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:22:21 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:DELETE=10,cinder:SELECT=63,cinder:INSERT=24,cinder:UPDATE=93 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:22:22 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=72,cinder:SELECT=45,cinder:INSERT=19,cinder:DELETE=3 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Flow 'volume_create_manager' (f1be158c-9794-440b-bbb1-20fb87dfb4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59771418-6448-446a-a805-a15f2e4bea18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59771418-6448-446a-a805-a15f2e4bea18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-130390760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43dc7868-77b1-4195-9f45-f0b27db949de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a38e37b1cae041d2acb72815bd1bb25c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:22:24Z,use_quota=True,user_id='791635f9c8144b8eaa6baa05ace7c56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abe97b78-0fb8-43e1-807a-46b60745d5c4),volume_type_id=abe97b78-0fb8-43e1-807a-46b60745d5c4)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362ae9ba-0993-499c-8914-d4ab1a1cf6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362ae9ba-0993-499c-8914-d4ab1a1cf6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc420c5-e1c7-4fb7-bf23-77bcebb3863b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc420c5-e1c7-4fb7-bf23-77bcebb3863b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43dc7868-77b1-4195-9f45-f0b27db949de', 'volume_name': 'volume-43dc7868-77b1-4195-9f45-f0b27db949de', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9499f188-344b-4753-adce-70954ebd2450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9499f188-344b-4753-adce-70954ebd2450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (688b7d58-fc5f-4177-bf2c-38b00f0541ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:24 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Volume 43dc7868-77b1-4195-9f45-f0b27db949de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43dc7868-77b1-4195-9f45-f0b27db949de', 'volume_size': 1} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-130390760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43dc7868-77b1-4195-9f45-f0b27db949de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a38e37b1cae041d2acb72815bd1bb25c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:22:24Z,use_quota=True,user_id='791635f9c8144b8eaa6baa05ace7c56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(abe97b78-0fb8-43e1-807a-46b60745d5c4),volume_type_id=abe97b78-0fb8-43e1-807a-46b60745d5c4)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Creating volume 43dc7868-77b1-4195-9f45-f0b27db949de {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:22:24 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-43dc7868-77b1-4195-9f45-f0b27db949de 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:24 devstack sudo[110411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-43dc7868-77b1-4195-9f45-f0b27db949de 1073741824 Jun 25 17:22:24 devstack sudo[110411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Flow 'volume_create_manager' (052b098a-8422-439e-a6cd-3459e4dd1ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2816880-2e27-4c31-be35-24fa687902a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:24 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2816880-2e27-4c31-be35-24fa687902a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1428427937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f41fca69-d381-4d9d-851b-553549b4ef48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a38e37b1cae041d2acb72815bd1bb25c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:22:25Z,use_quota=True,user_id='791635f9c8144b8eaa6baa05ace7c56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(977b0021-224f-4969-85dd-ea6ec8e014a3),volume_type_id=977b0021-224f-4969-85dd-ea6ec8e014a3)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f4dcdb-4910-49a5-a31f-cc997f94ca40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f4dcdb-4910-49a5-a31f-cc997f94ca40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5178c1cc-780f-4402-bf93-fcc96e5c62a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5178c1cc-780f-4402-bf93-fcc96e5c62a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f41fca69-d381-4d9d-851b-553549b4ef48', 'volume_name': 'volume-f41fca69-d381-4d9d-851b-553549b4ef48', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45116593-1c4b-4aa0-941d-3dab60227f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45116593-1c4b-4aa0-941d-3dab60227f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93aaf24-5c9c-4053-8c11-fea6765cc554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:25 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Volume f41fca69-d381-4d9d-851b-553549b4ef48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f41fca69-d381-4d9d-851b-553549b4ef48', 'volume_size': 1} Jun 25 17:22:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:22:25 devstack sudo[110411]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-43dc7868-77b1-4195-9f45-f0b27db949de 1073741824" returned: 0 in 1.387s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-43dc7868-77b1-4195-9f45-f0b27db949de {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:25 devstack sudo[110417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-43dc7868-77b1-4195-9f45-f0b27db949de Jun 25 17:22:25 devstack sudo[110417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:25 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:22:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Flow 'volume_create_manager' (40f2e5eb-feb7-45fc-8438-f3a0f41dad67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:22:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05911ba-6172-4c0e-ae5e-c97f6b9cafc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05911ba-6172-4c0e-ae5e-c97f6b9cafc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1028246338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6e70dc-9e2e-4715-88aa-53e9839295cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a38e37b1cae041d2acb72815bd1bb25c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:22:26Z,use_quota=True,user_id='791635f9c8144b8eaa6baa05ace7c56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(072b5494-45c1-4be7-a37a-ff57e2edb411),volume_type_id=072b5494-45c1-4be7-a37a-ff57e2edb411)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e646ed53-4192-4f22-a238-c1f2d3ce4057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e646ed53-4192-4f22-a238-c1f2d3ce4057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:25 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c63b89-904b-499a-8663-13b9cc8adb24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:25 devstack cinder-volume[93869]: DEBUG cinder.image.glance [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Creating Keystone auth plugin from conf {{(pid=93869) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c63b89-904b-499a-8663-13b9cc8adb24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fb6e70dc-9e2e-4715-88aa-53e9839295cb', 'volume_name': 'volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb', 'volume_size': 1, 'image_id': '7284b115-4429-41ba-89c4-46e6a11c891c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7284b115-4429-41ba-89c4-46e6a11c891c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--198215211', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a38e37b1cae041d2acb72815bd1bb25c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7284b115-4429-41ba-89c4-46e6a11c891c', 'created_at': datetime.datetime(2026, 6, 25, 15, 22, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 22, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7284b115-4429-41ba-89c4-46e6a11c891c/file', 'properties': {}}, 'image_service': }' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373ccb2a-3b63-456d-b002-8e273b8e7767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373ccb2a-3b63-456d-b002-8e273b8e7767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84feb4ac-6b09-493f-a5c1-2c3375539db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:26 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Volume fb6e70dc-9e2e-4715-88aa-53e9839295cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb', 'volume_size': 1, 'image_id': '7284b115-4429-41ba-89c4-46e6a11c891c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7284b115-4429-41ba-89c4-46e6a11c891c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--198215211', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a38e37b1cae041d2acb72815bd1bb25c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7284b115-4429-41ba-89c4-46e6a11c891c', 'created_at': datetime.datetime(2026, 6, 25, 15, 22, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 22, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7284b115-4429-41ba-89c4-46e6a11c891c/file', 'properties': {}}, 'image_service': } Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Trying to clone fb6e70dc-9e2e-4715-88aa-53e9839295cb from image 7284b115-4429-41ba-89c4-46e6a11c891c at location (None, [{'url': 'file:///opt/stack/data/glance/images/7284b115-4429-41ba-89c4-46e6a11c891c', 'metadata': {}}]). {{(pid=93869) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 17:22:26 devstack sudo[110417]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-43dc7868-77b1-4195-9f45-f0b27db949de" returned: 0 in 0.996s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] <== create_volume: return (2468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.471s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.726s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1428427937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f41fca69-d381-4d9d-851b-553549b4ef48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a38e37b1cae041d2acb72815bd1bb25c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:22:25Z,use_quota=True,user_id='791635f9c8144b8eaa6baa05ace7c56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(977b0021-224f-4969-85dd-ea6ec8e014a3),volume_type_id=977b0021-224f-4969-85dd-ea6ec8e014a3)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Creating volume f41fca69-d381-4d9d-851b-553549b4ef48 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:22:26 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f41fca69-d381-4d9d-851b-553549b4ef48 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:26 devstack sudo[110420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f41fca69-d381-4d9d-851b-553549b4ef48 1073741824 Jun 25 17:22:26 devstack sudo[110420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (688b7d58-fc5f-4177-bf2c-38b00f0541ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43dc7868-77b1-4195-9f45-f0b27db949de', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4badaf6-625e-494a-ba52-e6595a24adf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:26 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Volume volume-43dc7868-77b1-4195-9f45-f0b27db949de (43dc7868-77b1-4195-9f45-f0b27db949de): created successfully Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4badaf6-625e-494a-ba52-e6595a24adf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:26 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Flow 'volume_create_manager' (f1be158c-9794-440b-bbb1-20fb87dfb4e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:22:26 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-8feed2b6-4ee2-47d8-b4f2-10c8efd886bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Created volume successfully. Jun 25 17:22:27 devstack sudo[110420]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f41fca69-d381-4d9d-851b-553549b4ef48 1073741824" returned: 0 in 1.182s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f41fca69-d381-4d9d-851b-553549b4ef48 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:28 devstack sudo[110426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f41fca69-d381-4d9d-851b-553549b4ef48 Jun 25 17:22:28 devstack sudo[110426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:28 devstack sudo[110426]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f41fca69-d381-4d9d-851b-553549b4ef48" returned: 0 in 0.787s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:28 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] <== create_volume: return (2020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:22:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:22:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93aaf24-5c9c-4053-8c11-fea6765cc554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f41fca69-d381-4d9d-851b-553549b4ef48', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491e9d1b-2bd0-4b6e-89f1-011538affd49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:28 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Volume volume-f41fca69-d381-4d9d-851b-553549b4ef48 (f41fca69-d381-4d9d-851b-553549b4ef48): created successfully Jun 25 17:22:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491e9d1b-2bd0-4b6e-89f1-011538affd49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:28 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Flow 'volume_create_manager' (052b098a-8422-439e-a6cd-3459e4dd1ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:22:28 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-e31daeb7-0719-4e67-a67f-e283ea5804e4 tempest-TestInstancesWithCinderVolumes-1089148136 None] Created volume successfully. Jun 25 17:22:30 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7284b115-4429-41ba-89c4-46e6a11c891c_c8xuqy7ndevstack@QuobyteHD, size 20.69 MB, duration 3.89 sec {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 17:22:30 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Image download 20.69 MB at 5.31 MB/s Jun 25 17:22:30 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[03536097-6223-4332-a277-0e60bf041bd6]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:22:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7284b115-4429-41ba-89c4-46e6a11c891c_c8xuqy7ndevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:30 devstack sudo[110429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7284b115-4429-41ba-89c4-46e6a11c891c_c8xuqy7ndevstack@QuobyteHD Jun 25 17:22:30 devstack sudo[110429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:31 devstack sudo[110429]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7284b115-4429-41ba-89c4-46e6a11c891c_c8xuqy7ndevstack@QuobyteHD" returned: 0 in 0.855s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:31 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Temporary image 7284b115-4429-41ba-89c4-46e6a11c891c is fetched for user 791635f9c8144b8eaa6baa05ace7c56a. {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 17:22:31 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39dfa64-7052-4bf5-9b0f-4cb3934462e8]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:22:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7284b115-4429-41ba-89c4-46e6a11c891c_c8xuqy7ndevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:31 devstack sudo[110434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7284b115-4429-41ba-89c4-46e6a11c891c_c8xuqy7ndevstack@QuobyteHD Jun 25 17:22:31 devstack sudo[110434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:31 devstack sudo[110434]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7284b115-4429-41ba-89c4-46e6a11c891c_c8xuqy7ndevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:22:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:22:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1028246338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6e70dc-9e2e-4715-88aa-53e9839295cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a38e37b1cae041d2acb72815bd1bb25c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:22:26Z,use_quota=True,user_id='791635f9c8144b8eaa6baa05ace7c56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(072b5494-45c1-4be7-a37a-ff57e2edb411),volume_type_id=072b5494-45c1-4be7-a37a-ff57e2edb411)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:22:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Creating volume fb6e70dc-9e2e-4715-88aa-53e9839295cb {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:22:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:22:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:22:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:22:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:22:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:22:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:22:31 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:22:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:32 devstack sudo[110439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb 1073741824 Jun 25 17:22:32 devstack sudo[110439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:33 devstack sudo[110439]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb 1073741824" returned: 0 in 1.251s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:33 devstack sudo[110445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb Jun 25 17:22:33 devstack sudo[110445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:33 devstack sudo[110445]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb" returned: 0 in 0.721s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:33 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] <== create_volume: return (2022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:22:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.026s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:22:34 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Attempting download of 7284b115-4429-41ba-89c4-46e6a11c891c ((None, [{'url': 'file:///opt/stack/data/glance/images/7284b115-4429-41ba-89c4-46e6a11c891c', 'metadata': {}}])) to volume fb6e70dc-9e2e-4715-88aa-53e9839295cb. {{(pid=93869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 17:22:34 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4371e3ad-a9cd-49ce-b2f2-9fe7dc5834d6]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:22:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7284b115-4429-41ba-89c4-46e6a11c891c_faqqbch4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:34 devstack sudo[110449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7284b115-4429-41ba-89c4-46e6a11c891c_faqqbch4 Jun 25 17:22:34 devstack sudo[110449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:34 devstack sudo[110449]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7284b115-4429-41ba-89c4-46e6a11c891c_faqqbch4" returned: 0 in 0.855s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7284b115-4429-41ba-89c4-46e6a11c891c_faqqbch4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:35 devstack sudo[110487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7284b115-4429-41ba-89c4-46e6a11c891c_faqqbch4 Jun 25 17:22:35 devstack sudo[110487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:35 devstack sudo[110487]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7284b115-4429-41ba-89c4-46e6a11c891c_faqqbch4" returned: 1 in 0.948s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7284b115-4429-41ba-89c4-46e6a11c891c_faqqbch4' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:22:35 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bed91e-38a2-49dc-94e8-c25ad080e9be]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:22:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7284b115-4429-41ba-89c4-46e6a11c891c_c8xuqy7ndevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:36 devstack sudo[110493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7284b115-4429-41ba-89c4-46e6a11c891c_c8xuqy7ndevstack@QuobyteHD Jun 25 17:22:36 devstack sudo[110493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:36 devstack sudo[110493]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7284b115-4429-41ba-89c4-46e6a11c891c_c8xuqy7ndevstack@QuobyteHD" returned: 0 in 0.853s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:36 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] 7284b115-4429-41ba-89c4-46e6a11c891c was qcow2, converting to raw {{(pid=93869) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 17:22:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7284b115-4429-41ba-89c4-46e6a11c891c_c8xuqy7ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:36 devstack sudo[110498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7284b115-4429-41ba-89c4-46e6a11c891c_c8xuqy7ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb Jun 25 17:22:36 devstack sudo[110498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:39 devstack sudo[110498]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7284b115-4429-41ba-89c4-46e6a11c891c_c8xuqy7ndevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb" returned: 0 in 2.420s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:39 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7284b115-4429-41ba-89c4-46e6a11c891c_c8xuqy7ndevstack@QuobyteHD, size 112.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:22:39 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Converted 112.00 MB image at 46.25 MB/s Jun 25 17:22:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:39 devstack sudo[110508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb 1G Jun 25 17:22:39 devstack sudo[110508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:39 devstack sudo[110508]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb 1G" returned: 0 in 0.784s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:40 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[56802937-6c9d-46aa-b81b-b63e16abc1c3]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:22:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:40 devstack sudo[110513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb Jun 25 17:22:40 devstack sudo[110513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:40 devstack sudo[110513]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb" returned: 0 in 0.948s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:40 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:22:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Flow 'volume_create_manager' (2b3d325b-d402-4f87-97fc-0e3ce301abdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd338dd-01d2-45ce-8cd9-d76db14e2109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd338dd-01d2-45ce-8cd9-d76db14e2109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-548568905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805a1b26-8058-4b9d-8f3d-657634ccd11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6985c669afe4423aece33f6779bc1c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:22:41Z,use_quota=True,user_id='24d770b50e784dc2888a810259781256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec06a2e6-91dd-43d3-ba0e-312d4cd62c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec06a2e6-91dd-43d3-ba0e-312d4cd62c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c7a1d4-5968-42b6-84e4-6e84fe6fb4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c7a1d4-5968-42b6-84e4-6e84fe6fb4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '805a1b26-8058-4b9d-8f3d-657634ccd11a', 'volume_name': 'volume-805a1b26-8058-4b9d-8f3d-657634ccd11a', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab6d933-0fb3-4b9c-9e23-acb7403b67c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fab6d933-0fb3-4b9c-9e23-acb7403b67c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac0bb93-a288-4e61-abd9-dcb95fbd6435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:41 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Volume 805a1b26-8058-4b9d-8f3d-657634ccd11a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-805a1b26-8058-4b9d-8f3d-657634ccd11a', 'volume_size': 1} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-548568905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=805a1b26-8058-4b9d-8f3d-657634ccd11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6985c669afe4423aece33f6779bc1c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:22:41Z,use_quota=True,user_id='24d770b50e784dc2888a810259781256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Creating volume 805a1b26-8058-4b9d-8f3d-657634ccd11a {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:22:41 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:41 devstack sudo[110517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb Jun 25 17:22:41 devstack sudo[110517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:41 devstack sudo[110519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a 1073741824 Jun 25 17:22:41 devstack sudo[110519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:41 devstack sudo[110517]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb" returned: 1 in 0.819s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Downloaded image 7284b115-4429-41ba-89c4-46e6a11c891c ((None, [{'url': 'file:///opt/stack/data/glance/images/7284b115-4429-41ba-89c4-46e6a11c891c', 'metadata': {}}])) to volume fb6e70dc-9e2e-4715-88aa-53e9839295cb successfully. {{(pid=93869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Temporary image 7284b115-4429-41ba-89c4-46e6a11c891c for user 791635f9c8144b8eaa6baa05ace7c56a is deleted. {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Marking volume fb6e70dc-9e2e-4715-88aa-53e9839295cb as bootable. {{(pid=93869) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Copying metadata from image 7284b115-4429-41ba-89c4-46e6a11c891c to fb6e70dc-9e2e-4715-88aa-53e9839295cb. {{(pid=93869) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Creating volume glance metadata for volume fb6e70dc-9e2e-4715-88aa-53e9839295cb backed by image 7284b115-4429-41ba-89c4-46e6a11c891c with: {'image_id': '7284b115-4429-41ba-89c4-46e6a11c891c', 'image_name': 'tempest-scenario-img--198215211', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93869) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84feb4ac-6b09-493f-a5c1-2c3375539db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb', 'volume_size': 1, 'image_id': '7284b115-4429-41ba-89c4-46e6a11c891c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7284b115-4429-41ba-89c4-46e6a11c891c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--198215211', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a38e37b1cae041d2acb72815bd1bb25c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7284b115-4429-41ba-89c4-46e6a11c891c', 'created_at': datetime.datetime(2026, 6, 25, 15, 22, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 22, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7284b115-4429-41ba-89c4-46e6a11c891c/file', 'properties': {}}, 'image_service': }' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d347ee-328d-4b04-b19e-1f70ebf58d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:41 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Volume volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb (fb6e70dc-9e2e-4715-88aa-53e9839295cb): created successfully Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81d347ee-328d-4b04-b19e-1f70ebf58d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Flow 'volume_create_manager' (40f2e5eb-feb7-45fc-8438-f3a0f41dad67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:22:41 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-2ca50744-6678-44a4-bd7c-80e4d06d5967 tempest-TestInstancesWithCinderVolumes-1089148136 None] Created volume successfully. Jun 25 17:22:42 devstack sudo[110519]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a 1073741824" returned: 0 in 1.049s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:42 devstack sudo[110529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a Jun 25 17:22:42 devstack sudo[110529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:42 devstack sudo[110529]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a" returned: 0 in 0.648s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:42 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:22:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:22:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac0bb93-a288-4e61-abd9-dcb95fbd6435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-805a1b26-8058-4b9d-8f3d-657634ccd11a', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cf7ed8-e065-4f82-9b0e-07eb992016e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:42 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Volume volume-805a1b26-8058-4b9d-8f3d-657634ccd11a (805a1b26-8058-4b9d-8f3d-657634ccd11a): created successfully Jun 25 17:22:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2cf7ed8-e065-4f82-9b0e-07eb992016e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Flow 'volume_create_manager' (2b3d325b-d402-4f87-97fc-0e3ce301abdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:22:42 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-4cc10ec5-553e-459d-a77c-6af3a1f6d272 tempest-SnapshotDependencyTests-1883611194 None] Created volume successfully. Jun 25 17:22:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-df2edffa-1a3f-4879-8e19-1e095694411a tempest-SnapshotDependencyTests-1883611194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:22:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-df2edffa-1a3f-4879-8e19-1e095694411a tempest-SnapshotDependencyTests-1883611194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:22:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-df2edffa-1a3f-4879-8e19-1e095694411a tempest-SnapshotDependencyTests-1883611194 None] Creating offline snapshot 3de266b8-f60b-4462-98b1-8a618124f708 of volume 805a1b26-8058-4b9d-8f3d-657634ccd11a {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:22:43 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a18bb02-73f8-472d-9369-3086098d4c0a]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:22:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-df2edffa-1a3f-4879-8e19-1e095694411a tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:43 devstack sudo[110532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a Jun 25 17:22:43 devstack sudo[110532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:44 devstack sudo[110532]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-df2edffa-1a3f-4879-8e19-1e095694411a tempest-SnapshotDependencyTests-1883611194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a" returned: 0 in 0.857s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-df2edffa-1a3f-4879-8e19-1e095694411a tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:44 devstack sudo[110538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708 1G Jun 25 17:22:44 devstack sudo[110538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:22:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:22:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:22:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:22:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:22:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:22:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:44 devstack sudo[110540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:22:44 devstack sudo[110540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:45 devstack sudo[110540]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.903s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:22:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:22:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 28 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:22:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:22:45 devstack sudo[110538]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-df2edffa-1a3f-4879-8e19-1e095694411a tempest-SnapshotDependencyTests-1883611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708 1G" returned: 0 in 1.079s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-df2edffa-1a3f-4879-8e19-1e095694411a tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-805a1b26-8058-4b9d-8f3d-657634ccd11a -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:45 devstack sudo[110550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-805a1b26-8058-4b9d-8f3d-657634ccd11a -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708 Jun 25 17:22:45 devstack sudo[110550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:46 devstack sudo[110550]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-df2edffa-1a3f-4879-8e19-1e095694411a tempest-SnapshotDependencyTests-1883611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-805a1b26-8058-4b9d-8f3d-657634ccd11a -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708" returned: 0 in 0.811s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:46 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-df2edffa-1a3f-4879-8e19-1e095694411a tempest-SnapshotDependencyTests-1883611194 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708 is being set with open permissions: ugo+rw Jun 25 17:22:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-df2edffa-1a3f-4879-8e19-1e095694411a tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:46 devstack sudo[110555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708 Jun 25 17:22:46 devstack sudo[110555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:46 devstack sudo[110555]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-df2edffa-1a3f-4879-8e19-1e095694411a tempest-SnapshotDependencyTests-1883611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708" returned: 0 in 0.766s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-df2edffa-1a3f-4879-8e19-1e095694411a tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:46 devstack sudo[110558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.info Jun 25 17:22:46 devstack sudo[110558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:47 devstack sudo[110558]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-df2edffa-1a3f-4879-8e19-1e095694411a tempest-SnapshotDependencyTests-1883611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.info" returned: 0 in 0.713s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:47 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-df2edffa-1a3f-4879-8e19-1e095694411a tempest-SnapshotDependencyTests-1883611194 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.info is being set with open permissions: ugo+rw Jun 25 17:22:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-df2edffa-1a3f-4879-8e19-1e095694411a tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:47 devstack sudo[110561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.info Jun 25 17:22:47 devstack sudo[110561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:48 devstack sudo[110561]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-df2edffa-1a3f-4879-8e19-1e095694411a tempest-SnapshotDependencyTests-1883611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.info" returned: 0 in 0.715s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-df2edffa-1a3f-4879-8e19-1e095694411a tempest-SnapshotDependencyTests-1883611194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.046s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:22:48 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-df2edffa-1a3f-4879-8e19-1e095694411a tempest-SnapshotDependencyTests-1883611194 None] Create snapshot completed successfully Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Flow 'volume_create_manager' (a4593805-529c-442a-b9de-2c649b3d5e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5111b7a4-2379-4a6b-be03-d8de883967ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5111b7a4-2379-4a6b-be03-d8de883967ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2dcf08-8438-4c3c-9a3c-0ea7f725f324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6985c669afe4423aece33f6779bc1c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3de266b8-f60b-4462-98b1-8a618124f708,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:22:49Z,use_quota=True,user_id='24d770b50e784dc2888a810259781256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00265355-c06e-4da0-aa98-f8f778cfd6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00265355-c06e-4da0-aa98-f8f778cfd6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbad58c-4ef9-47c7-befd-9173e2d2059f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbbad58c-4ef9-47c7-befd-9173e2d2059f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0b2dcf08-8438-4c3c-9a3c-0ea7f725f324', 'volume_name': 'volume-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324', 'volume_size': 1, 'snapshot_id': '3de266b8-f60b-4462-98b1-8a618124f708'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5399335c-657b-46f9-b7fc-cf82c663687f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5399335c-657b-46f9-b7fc-cf82c663687f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c0e136-dce7-406d-8090-05b05085350c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:49 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Volume 0b2dcf08-8438-4c3c-9a3c-0ea7f725f324: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324', 'volume_size': 1, 'snapshot_id': '3de266b8-f60b-4462-98b1-8a618124f708'} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Acquiring lock "cinder-quobyte-3de266b8-f60b-4462-98b1-8a618124f708-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324" by "_create_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Lock "cinder-quobyte-3de266b8-f60b-4462-98b1-8a618124f708-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Creating volume 0b2dcf08-8438-4c3c-9a3c-0ea7f725f324 from snapshot 3de266b8-f60b-4462-98b1-8a618124f708 {{(pid=93869) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Acquiring lock "cinder-quobyte-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324" by "_copy_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Lock "cinder-quobyte-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] snapshot: 3de266b8-f60b-4462-98b1-8a618124f708, volume: 0b2dcf08-8438-4c3c-9a3c-0ea7f725f324, {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0cc982-c507-4369-87ba-de2825b94e66]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:22:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:49 devstack sudo[110564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708 Jun 25 17:22:49 devstack sudo[110564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:50 devstack sudo[110564]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708" returned: 0 in 1.073s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-805a1b26-8058-4b9d-8f3d-657634ccd11a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:22:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] will copy from snapshot at /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 17:22:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Creating direct copy from snapshot {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 17:22:50 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa9dd7b-1825-4a4a-ba13-551c5cfb0bfd]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:22:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:50 devstack sudo[110577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a Jun 25 17:22:50 devstack sudo[110577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-b0d3e726-5c4f-472d-b9e1-b741a0fa4a4b req-c1635098-59e8-4af0-86ad-9ad33c268fa9 tempest-TestInstancesWithCinderVolumes-1089148136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:22:51 devstack sudo[110577]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a" returned: 0 in 0.985s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:51 devstack cinder-volume[93869]: DEBUG cinder.utils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Path /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324 not found in is_blk_device check {{(pid=93869) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 17:22:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:51 devstack sudo[110585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324 Jun 25 17:22:51 devstack sudo[110585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:57 devstack sudo[110585]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324" returned: 0 in 5.457s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:57 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d83cf3-805d-470a-b08a-78a4546ff467]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:22:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:57 devstack sudo[110600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a Jun 25 17:22:57 devstack sudo[110600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:58 devstack sudo[110600]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a" returned: 0 in 1.040s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:58 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Image conversion details: src /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a, size 1024.00 MB, duration 5.46 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324 {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:22:58 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Converted 1024.00 MB image at 187.61 MB/s Jun 25 17:22:58 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324 is being set with open permissions: ugo+rw Jun 25 17:22:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:58 devstack sudo[110605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324 Jun 25 17:22:58 devstack sudo[110605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:58 devstack sudo[110605]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324" returned: 0 in 0.694s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Lock "cinder-quobyte-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324" released by "_copy_volume_from_snapshot" :: held 9.391s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:22:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Lock "cinder-quobyte-3de266b8-f60b-4462-98b1-8a618124f708-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324" released by "_create_volume_from_snapshot" :: held 9.434s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:22:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.455s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:22:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-b0d3e726-5c4f-472d-b9e1-b741a0fa4a4b req-c1635098-59e8-4af0-86ad-9ad33c268fa9 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.988s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:22:58 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[239e1948-fa6d-417a-ae58-f1ebefb0a745]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:22:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-b0d3e726-5c4f-472d-b9e1-b741a0fa4a4b req-c1635098-59e8-4af0-86ad-9ad33c268fa9 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:58 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c0e136-dce7-406d-8090-05b05085350c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324', 'volume_size': 1, 'snapshot_id': '3de266b8-f60b-4462-98b1-8a618124f708'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:58 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a1d0c0-a673-47bb-8d6b-93a51d26bebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:22:58 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Volume volume-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324 (0b2dcf08-8438-4c3c-9a3c-0ea7f725f324): created successfully Jun 25 17:22:58 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a1d0c0-a673-47bb-8d6b-93a51d26bebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:22:58 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Flow 'volume_create_manager' (a4593805-529c-442a-b9de-2c649b3d5e9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:22:58 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-6041426f-e29a-4cd8-bb5e-9b660591cc1f tempest-SnapshotDependencyTests-1883611194 None] Created volume successfully. Jun 25 17:22:59 devstack sudo[110614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb Jun 25 17:22:59 devstack sudo[110614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] Acquiring lock "cinder-3de266b8-f60b-4462-98b1-8a618124f708-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:22:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] Lock "cinder-3de266b8-f60b-4462-98b1-8a618124f708-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:22:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] Acquiring lock "cinder-quobyte-805a1b26-8058-4b9d-8f3d-657634ccd11a" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:22:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] Lock "cinder-quobyte-805a1b26-8058-4b9d-8f3d-657634ccd11a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:22:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] Acquiring lock "cinder-quobyte-3de266b8-f60b-4462-98b1-8a618124f708" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:22:59 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] Lock "cinder-quobyte-3de266b8-f60b-4462-98b1-8a618124f708" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:22:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] Deleting offline snapshot 3de266b8-f60b-4462-98b1-8a618124f708 of volume 805a1b26-8058-4b9d-8f3d-657634ccd11a {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:22:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] snapshot_file for this snap is: volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:22:59 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[789bd4f9-3e67-419e-8c86-e4ef6627e8f2]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:22:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:59 devstack sudo[110616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708 Jun 25 17:22:59 devstack sudo[110616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:22:59 devstack sudo[110614]: pam_unix(sudo:session): session closed for user root Jun 25 17:22:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-b0d3e726-5c4f-472d-b9e1-b741a0fa4a4b req-c1635098-59e8-4af0-86ad-9ad33c268fa9 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb" returned: 0 in 0.884s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:22:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-b0d3e726-5c4f-472d-b9e1-b741a0fa4a4b req-c1635098-59e8-4af0-86ad-9ad33c268fa9 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:22:59 devstack sudo[110620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb Jun 25 17:22:59 devstack sudo[110620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:23:00 devstack sudo[110616]: pam_unix(sudo:session): session closed for user root Jun 25 17:23:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708" returned: 0 in 0.948s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:23:00 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-805a1b26-8058-4b9d-8f3d-657634ccd11a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:23:00 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5542c3a2-44f9-47b1-98fc-23c5c7fd3d76]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:23:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:23:00 devstack sudo[110625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a Jun 25 17:23:00 devstack sudo[110625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:23:00 devstack sudo[110620]: pam_unix(sudo:session): session closed for user root Jun 25 17:23:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-b0d3e726-5c4f-472d-b9e1-b741a0fa4a4b req-c1635098-59e8-4af0-86ad-9ad33c268fa9 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb" returned: 1 in 0.859s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:23:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-b0d3e726-5c4f-472d-b9e1-b741a0fa4a4b req-c1635098-59e8-4af0-86ad-9ad33c268fa9 tempest-TestInstancesWithCinderVolumes-1089148136 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:23:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-b0d3e726-5c4f-472d-b9e1-b741a0fa4a4b req-c1635098-59e8-4af0-86ad-9ad33c268fa9 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.799s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:23:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-b0d3e726-5c4f-472d-b9e1-b741a0fa4a4b req-c1635098-59e8-4af0-86ad-9ad33c268fa9 tempest-TestInstancesWithCinderVolumes-1089148136 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbff3753-ad6a-4e52-ba88-3161d44cec23', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:23:00 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-b0d3e726-5c4f-472d-b9e1-b741a0fa4a4b req-c1635098-59e8-4af0-86ad-9ad33c268fa9 tempest-TestInstancesWithCinderVolumes-1089148136 None] attachment_update completed successfully. Jun 25 17:23:01 devstack sudo[110625]: pam_unix(sudo:session): session closed for user root Jun 25 17:23:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a" returned: 0 in 0.806s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:23:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:23:01 devstack sudo[110633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708 Jun 25 17:23:01 devstack sudo[110633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:23:01 devstack sudo[110633]: pam_unix(sudo:session): session closed for user root Jun 25 17:23:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708" returned: 0 in 0.775s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:23:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:23:01 devstack sudo[110638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708 Jun 25 17:23:01 devstack sudo[110638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:23:02 devstack sudo[110638]: pam_unix(sudo:session): session closed for user root Jun 25 17:23:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a.3de266b8-f60b-4462-98b1-8a618124f708" returned: 0 in 0.736s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:23:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] Lock "cinder-quobyte-3de266b8-f60b-4462-98b1-8a618124f708" released by "_delete_snapshot" :: held 3.415s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:23:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] Lock "cinder-quobyte-805a1b26-8058-4b9d-8f3d-657634ccd11a" released by "delete_snapshot" :: held 3.448s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:23:02 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] Created reservations ['78324faa-b151-4118-9797-5436c1ec00b5', '0691fbf5-f52b-43c2-b06d-2f35ac5a1e09', 'b354a538-a1e2-4e02-8360-0f88b09c74c3', '5449202e-542d-46f0-aedd-6c8a056273cf'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:23:02 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] Delete snapshot completed successfully. Jun 25 17:23:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-4c197dcd-09f1-4555-83ef-baa6b25cf91c tempest-SnapshotDependencyTests-1883611194 None] Lock "cinder-3de266b8-f60b-4462-98b1-8a618124f708-delete_snapshot" released by "delete_snapshot" :: held 3.636s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:23:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] Acquiring lock "cinder-805a1b26-8058-4b9d-8f3d-657634ccd11a-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:23:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] Lock "cinder-805a1b26-8058-4b9d-8f3d-657634ccd11a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:23:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] Acquiring lock "cinder-quobyte-805a1b26-8058-4b9d-8f3d-657634ccd11a" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:23:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] Lock "cinder-quobyte-805a1b26-8058-4b9d-8f3d-657634ccd11a" acquired by "delete_volume" :: waited 0.017s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:23:03 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3df44c9-1822-47e8-9b6f-79561f20a4ab]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:23:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:23:03 devstack sudo[110709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a Jun 25 17:23:03 devstack sudo[110709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:23:04 devstack sudo[110709]: pam_unix(sudo:session): session closed for user root Jun 25 17:23:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a" returned: 0 in 0.855s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:23:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:23:04 devstack sudo[110717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a Jun 25 17:23:04 devstack sudo[110717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:23:05 devstack sudo[110717]: pam_unix(sudo:session): session closed for user root Jun 25 17:23:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-805a1b26-8058-4b9d-8f3d-657634ccd11a" returned: 0 in 0.663s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:23:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] Lock "cinder-quobyte-805a1b26-8058-4b9d-8f3d-657634ccd11a" released by "delete_volume" :: held 1.582s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:23:05 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] Created reservations ['160df0a7-8174-4d9e-aced-343cb82b8eb0', '3d8e1917-c5b1-4c99-878a-eac7edfe6c54', '6d3d7743-bb64-48d0-88c0-be57e3ac1475', '0ede5241-1f58-4d4e-baff-0b6aea6eb017'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:23:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:23:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:23:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:23:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:23:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:23:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:23:05 devstack sudo[110720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:23:05 devstack sudo[110720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:23:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] Acquiring lock "cinder-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:23:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] Lock "cinder-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:23:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] Acquiring lock "cinder-quobyte-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:23:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] Lock "cinder-quobyte-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324" acquired by "delete_volume" :: waited 0.026s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:23:06 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f92096f-24fc-405e-9b2d-170902fd4773]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:23:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:23:06 devstack sudo[110720]: pam_unix(sudo:session): session closed for user root Jun 25 17:23:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.849s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:23:06 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:23:06 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] Deleted volume successfully. Jun 25 17:23:06 devstack sudo[111045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324 Jun 25 17:23:06 devstack sudo[111045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:23:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-2d41e0cc-03ae-4856-98c4-376bdbe0b2fc tempest-SnapshotDependencyTests-1883611194 None] Lock "cinder-805a1b26-8058-4b9d-8f3d-657634ccd11a-delete_volume" released by "delete_volume" :: held 2.674s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:23:07 devstack sudo[111045]: pam_unix(sudo:session): session closed for user root Jun 25 17:23:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324" returned: 0 in 1.240s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:23:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:23:07 devstack sudo[111111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324 Jun 25 17:23:07 devstack sudo[111111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:23:08 devstack sudo[111111]: pam_unix(sudo:session): session closed for user root Jun 25 17:23:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324" returned: 0 in 0.964s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:23:08 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] Lock "cinder-quobyte-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324" released by "delete_volume" :: held 2.268s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:23:08 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] Created reservations ['a3cd6239-040b-485e-8120-f444dcad74bb', 'f12d29fe-6383-4f68-af24-b4792baa79c0', '934d2960-df4c-43b2-9435-acdddb579440', 'd7ec6f96-dbc0-4296-9233-ad942c1ab46a'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:23:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:23:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:23:08 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:23:08 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:23:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:23:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:23:08 devstack sudo[111123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:23:08 devstack sudo[111123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:23:09 devstack sudo[111123]: pam_unix(sudo:session): session closed for user root Jun 25 17:23:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.036s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:23:09 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:23:09 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] Deleted volume successfully. Jun 25 17:23:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-cbe01031-9f78-4a4a-a0d0-c8c168520efd tempest-SnapshotDependencyTests-1883611194 None] Lock "cinder-0b2dcf08-8438-4c3c-9a3c-0ea7f725f324-delete_volume" released by "delete_volume" :: held 3.634s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:23:18 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=38,cinder:SELECT=41,cinder:INSERT=16,cinder:DELETE=3 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:23:19 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=41,cinder:UPDATE=43,cinder:INSERT=10,cinder:DELETE=5 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:23:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-297621f1-9784-4f11-b644-3ecb12a6337c req-eea6a820-9fde-4032-a44e-f319026cc622 tempest-TestInstancesWithCinderVolumes-1089148136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:23:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-297621f1-9784-4f11-b644-3ecb12a6337c req-eea6a820-9fde-4032-a44e-f319026cc622 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:23:41 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[31594cb9-5f50-4266-87f2-d146d5cd0392]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:23:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-297621f1-9784-4f11-b644-3ecb12a6337c req-eea6a820-9fde-4032-a44e-f319026cc622 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-43dc7868-77b1-4195-9f45-f0b27db949de {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:23:42 devstack sudo[111284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-43dc7868-77b1-4195-9f45-f0b27db949de Jun 25 17:23:42 devstack sudo[111284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:23:42 devstack sudo[111284]: pam_unix(sudo:session): session closed for user root Jun 25 17:23:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-297621f1-9784-4f11-b644-3ecb12a6337c req-eea6a820-9fde-4032-a44e-f319026cc622 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-43dc7868-77b1-4195-9f45-f0b27db949de" returned: 0 in 0.875s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:23:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-297621f1-9784-4f11-b644-3ecb12a6337c req-eea6a820-9fde-4032-a44e-f319026cc622 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.897s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:23:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-297621f1-9784-4f11-b644-3ecb12a6337c req-eea6a820-9fde-4032-a44e-f319026cc622 tempest-TestInstancesWithCinderVolumes-1089148136 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-43dc7868-77b1-4195-9f45-f0b27db949de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '749bc0b5-3809-487a-8f24-5ad5e65ed52d', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:23:42 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-297621f1-9784-4f11-b644-3ecb12a6337c req-eea6a820-9fde-4032-a44e-f319026cc622 tempest-TestInstancesWithCinderVolumes-1089148136 None] attachment_update completed successfully. Jun 25 17:23:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:23:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:23:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:23:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:23:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:23:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:23:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:23:44 devstack sudo[111295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:23:44 devstack sudo[111295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:23:45 devstack sudo[111295]: pam_unix(sudo:session): session closed for user root Jun 25 17:23:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.783s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:23:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:23:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:23:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 28 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:23:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:23:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-b26a47a0-009d-4d97-a5ba-eb260a37249b req-27eed405-95cc-4f2a-99cc-2d2965beb2b6 tempest-TestInstancesWithCinderVolumes-1089148136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:23:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-b26a47a0-009d-4d97-a5ba-eb260a37249b req-27eed405-95cc-4f2a-99cc-2d2965beb2b6 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:23:51 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8236040-8075-4910-b3a4-250bfb6aa199]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:23:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-b26a47a0-009d-4d97-a5ba-eb260a37249b req-27eed405-95cc-4f2a-99cc-2d2965beb2b6 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f41fca69-d381-4d9d-851b-553549b4ef48 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:23:51 devstack sudo[111315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f41fca69-d381-4d9d-851b-553549b4ef48 Jun 25 17:23:51 devstack sudo[111315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:23:52 devstack sudo[111315]: pam_unix(sudo:session): session closed for user root Jun 25 17:23:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-b26a47a0-009d-4d97-a5ba-eb260a37249b req-27eed405-95cc-4f2a-99cc-2d2965beb2b6 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f41fca69-d381-4d9d-851b-553549b4ef48" returned: 0 in 0.784s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:23:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-b26a47a0-009d-4d97-a5ba-eb260a37249b req-27eed405-95cc-4f2a-99cc-2d2965beb2b6 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.802s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:23:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-b26a47a0-009d-4d97-a5ba-eb260a37249b req-27eed405-95cc-4f2a-99cc-2d2965beb2b6 tempest-TestInstancesWithCinderVolumes-1089148136 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-f41fca69-d381-4d9d-851b-553549b4ef48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd38a0b9-f05b-4690-badc-e26a49ab0b50', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:23:52 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-b26a47a0-009d-4d97-a5ba-eb260a37249b req-27eed405-95cc-4f2a-99cc-2d2965beb2b6 tempest-TestInstancesWithCinderVolumes-1089148136 None] attachment_update completed successfully. Jun 25 17:24:01 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-5a06cb64-bc33-41c7-b933-0bf9330d2a05 req-82c98423-4ec5-4b38-a994-17df465b03bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Terminate volume connection completed successfully. Jun 25 17:24:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-5a06cb64-bc33-41c7-b933-0bf9330d2a05 req-82c98423-4ec5-4b38-a994-17df465b03bf tempest-TestInstancesWithCinderVolumes-1089148136 None] Deleting attachment 749bc0b5-3809-487a-8f24-5ad5e65ed52d. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:24:02 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=11,cinder:UPDATE=2 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:24:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] Acquiring lock "cinder-43dc7868-77b1-4195-9f45-f0b27db949de-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:24:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "cinder-43dc7868-77b1-4195-9f45-f0b27db949de-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:24:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] Acquiring lock "cinder-quobyte-43dc7868-77b1-4195-9f45-f0b27db949de" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:24:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "cinder-quobyte-43dc7868-77b1-4195-9f45-f0b27db949de" acquired by "delete_volume" :: waited 0.017s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:24:03 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3f0630-05a6-4827-a738-13d02b1fbb68]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:24:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-43dc7868-77b1-4195-9f45-f0b27db949de {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:24:03 devstack sudo[111375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-43dc7868-77b1-4195-9f45-f0b27db949de Jun 25 17:24:03 devstack sudo[111375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:24:04 devstack sudo[111375]: pam_unix(sudo:session): session closed for user root Jun 25 17:24:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-43dc7868-77b1-4195-9f45-f0b27db949de" returned: 0 in 0.853s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:24:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-43dc7868-77b1-4195-9f45-f0b27db949de {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:24:04 devstack sudo[111381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-43dc7868-77b1-4195-9f45-f0b27db949de Jun 25 17:24:04 devstack sudo[111381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:24:05 devstack sudo[111381]: pam_unix(sudo:session): session closed for user root Jun 25 17:24:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-43dc7868-77b1-4195-9f45-f0b27db949de" returned: 0 in 0.752s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:24:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "cinder-quobyte-43dc7868-77b1-4195-9f45-f0b27db949de" released by "delete_volume" :: held 1.653s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:24:05 devstack cinder-volume[93869]: WARNING cinder.quota [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1617710012-236741529 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1617710012-236741529, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:24:05 devstack cinder-volume[93869]: WARNING cinder.quota [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1617710012-236741529 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1617710012-236741529, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:24:05 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] Created reservations ['8c25406b-3acd-4374-ac93-2c05613ceb02', 'af92026f-51e0-47ce-a50e-345da503ef02', '2e956779-df65-49fd-8015-02fa4842a4e2', '0fa5a108-3a34-4668-a987-63960ad2d49e'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:24:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:24:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:24:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:24:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:24:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:24:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:24:05 devstack sudo[111384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:24:05 devstack sudo[111384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:24:05 devstack sudo[111384]: pam_unix(sudo:session): session closed for user root Jun 25 17:24:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.747s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:24:05 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:24:05 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] Deleted volume successfully. Jun 25 17:24:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-68893eb2-c860-4734-9097-54a7f728afd2 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "cinder-43dc7868-77b1-4195-9f45-f0b27db949de-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:24:08 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-030d4d2c-9324-4250-adc3-b4d72e632194 req-921e006b-d9a7-47c4-9197-b9900b4c6508 tempest-TestInstancesWithCinderVolumes-1089148136 None] Terminate volume connection completed successfully. Jun 25 17:24:08 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-030d4d2c-9324-4250-adc3-b4d72e632194 req-921e006b-d9a7-47c4-9197-b9900b4c6508 tempest-TestInstancesWithCinderVolumes-1089148136 None] Deleting attachment bd38a0b9-f05b-4690-badc-e26a49ab0b50. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:24:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] Acquiring lock "cinder-f41fca69-d381-4d9d-851b-553549b4ef48-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:24:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "cinder-f41fca69-d381-4d9d-851b-553549b4ef48-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:24:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] Acquiring lock "cinder-quobyte-f41fca69-d381-4d9d-851b-553549b4ef48" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:24:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "cinder-quobyte-f41fca69-d381-4d9d-851b-553549b4ef48" acquired by "delete_volume" :: waited 0.014s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:24:10 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[005bd47c-d86c-484d-a8b1-7d3c49ca4e1a]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:24:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f41fca69-d381-4d9d-851b-553549b4ef48 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:24:10 devstack sudo[111414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f41fca69-d381-4d9d-851b-553549b4ef48 Jun 25 17:24:10 devstack sudo[111414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:24:10 devstack sudo[111414]: pam_unix(sudo:session): session closed for user root Jun 25 17:24:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f41fca69-d381-4d9d-851b-553549b4ef48" returned: 0 in 0.856s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:24:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f41fca69-d381-4d9d-851b-553549b4ef48 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:24:10 devstack sudo[111420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f41fca69-d381-4d9d-851b-553549b4ef48 Jun 25 17:24:10 devstack sudo[111420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:24:11 devstack sudo[111420]: pam_unix(sudo:session): session closed for user root Jun 25 17:24:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f41fca69-d381-4d9d-851b-553549b4ef48" returned: 0 in 0.704s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:24:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "cinder-quobyte-f41fca69-d381-4d9d-851b-553549b4ef48" released by "delete_volume" :: held 1.620s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:24:11 devstack cinder-volume[93869]: WARNING cinder.quota [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-757127074-399028793 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-757127074-399028793, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:24:11 devstack cinder-volume[93869]: WARNING cinder.quota [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-757127074-399028793 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-757127074-399028793, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:24:11 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] Created reservations ['cc231875-67aa-4e89-844a-d9c90a962c2b', 'a71768d5-c889-4da5-a408-d6c86c14e405', '7bf906ba-3137-4c00-83b1-df5ea74cc83a', 'dc06c871-d830-4729-add9-70f6aa7b8b68'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:24:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:24:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:24:11 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:24:11 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:24:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:24:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:24:11 devstack sudo[111425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:24:11 devstack sudo[111425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:24:12 devstack sudo[111425]: pam_unix(sudo:session): session closed for user root Jun 25 17:24:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.854s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:24:12 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:24:12 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] Deleted volume successfully. Jun 25 17:24:12 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-eae7312d-0d04-4151-826d-3db53d08d16e tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "cinder-f41fca69-d381-4d9d-851b-553549b4ef48-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:24:16 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-788f665f-38ba-4dce-9f20-dc54f85efd30 req-aa5502e6-d21a-4a30-a260-1c08a84b375b tempest-TestInstancesWithCinderVolumes-1089148136 None] Terminate volume connection completed successfully. Jun 25 17:24:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-788f665f-38ba-4dce-9f20-dc54f85efd30 req-aa5502e6-d21a-4a30-a260-1c08a84b375b tempest-TestInstancesWithCinderVolumes-1089148136 None] Deleting attachment bbff3753-ad6a-4e52-ba88-3161d44cec23. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:24:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Acquiring lock "cinder-fb6e70dc-9e2e-4715-88aa-53e9839295cb-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:24:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "cinder-fb6e70dc-9e2e-4715-88aa-53e9839295cb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:24:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Acquiring lock "cinder-quobyte-fb6e70dc-9e2e-4715-88aa-53e9839295cb" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:24:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "cinder-quobyte-fb6e70dc-9e2e-4715-88aa-53e9839295cb" acquired by "delete_volume" :: waited 0.018s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:24:20 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59abbfd-240a-430c-8258-1b2e06b979d0]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:24:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:24:20 devstack sudo[111479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb Jun 25 17:24:20 devstack sudo[111479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:24:21 devstack sudo[111479]: pam_unix(sudo:session): session closed for user root Jun 25 17:24:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb" returned: 0 in 0.778s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:24:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:24:21 devstack sudo[111483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb Jun 25 17:24:21 devstack sudo[111483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:24:21 devstack sudo[111483]: pam_unix(sudo:session): session closed for user root Jun 25 17:24:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb" returned: 1 in 0.789s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:24:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:24:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:24:22 devstack sudo[111488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb Jun 25 17:24:22 devstack sudo[111488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:24:22 devstack sudo[111488]: pam_unix(sudo:session): session closed for user root Jun 25 17:24:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fb6e70dc-9e2e-4715-88aa-53e9839295cb" returned: 0 in 0.694s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:24:22 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "cinder-quobyte-fb6e70dc-9e2e-4715-88aa-53e9839295cb" released by "delete_volume" :: held 2.328s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:24:22 devstack cinder-volume[93869]: WARNING cinder.quota [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-114447951-1995365102 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-114447951-1995365102, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:24:22 devstack cinder-volume[93869]: WARNING cinder.quota [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-114447951-1995365102 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-114447951-1995365102, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:24:22 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Created reservations ['26d21d5e-3bfc-4ff2-b01a-f1e48d514e23', '8be2054e-1503-4641-bb4d-1c216d10d800', '071f328f-a80c-45d6-aabb-565ffbe154b6', '4199af8d-d66d-4a56-9a73-287d056040d0'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:24:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:24:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:24:22 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:24:22 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:24:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:24:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:24:22 devstack sudo[111491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:24:22 devstack sudo[111491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:24:23 devstack sudo[111491]: pam_unix(sudo:session): session closed for user root Jun 25 17:24:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.688s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:24:23 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:24:23 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Deleted volume successfully. Jun 25 17:24:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-69b51d4c-32be-465e-a7ae-875058efc390 tempest-TestInstancesWithCinderVolumes-1089148136 None] Lock "cinder-fb6e70dc-9e2e-4715-88aa-53e9839295cb-delete_volume" released by "delete_volume" :: held 3.252s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:24:32 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=31,cinder:UPDATE=28,cinder:INSERT=5,cinder:DELETE=2 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:24:33 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=24,cinder:SELECT=16,cinder:INSERT=7,cinder:DELETE=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:24:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:24:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:24:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:24:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:24:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:24:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:24:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:24:44 devstack sudo[111537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:24:44 devstack sudo[111537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:24:45 devstack sudo[111537]: pam_unix(sudo:session): session closed for user root Jun 25 17:24:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.802s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:24:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:24:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:24:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 28 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:24:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Flow 'volume_create_manager' (805ab870-523a-45c7-874a-cbbbadbfe18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c39051-bedf-42c9-baa6-ada88c199872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c39051-bedf-42c9-baa6-ada88c199872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-347152399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a4f27b9-c22c-4bc3-8770-73d711b3a1eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da7b9ba50a147e480d89211e28ea6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:24:55Z,use_quota=True,user_id='42a42cabef6949d18fca48da366bf9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97884839-03f0-4aa7-a15f-9ef3c1fcfe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97884839-03f0-4aa7-a15f-9ef3c1fcfe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7b85a7-2350-41a9-9de4-a28f0a5149c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe7b85a7-2350-41a9-9de4-a28f0a5149c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a4f27b9-c22c-4bc3-8770-73d711b3a1eb', 'volume_name': 'volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ef911c-f8a9-4d5d-bc50-5e32393e30a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6ef911c-f8a9-4d5d-bc50-5e32393e30a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffdd2128-22cb-47ec-b735-9a9d18511fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:24:54 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Volume 0a4f27b9-c22c-4bc3-8770-73d711b3a1eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb', 'volume_size': 1} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:24:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-347152399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a4f27b9-c22c-4bc3-8770-73d711b3a1eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da7b9ba50a147e480d89211e28ea6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:24:55Z,use_quota=True,user_id='42a42cabef6949d18fca48da366bf9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Creating volume 0a4f27b9-c22c-4bc3-8770-73d711b3a1eb {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:24:54 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:24:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:24:54 devstack sudo[111541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb 1073741824 Jun 25 17:24:54 devstack sudo[111541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:24:55 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:24:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Flow 'volume_create_manager' (d11593c8-586b-44f0-be1b-bae2fc49d8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:24:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1f313a-87ac-465f-9c54-146d29840121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:24:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd1f313a-87ac-465f-9c54-146d29840121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1413269924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d586c1d4-1264-46a3-8f95-fda1f99d33ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da7b9ba50a147e480d89211e28ea6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:24:55Z,use_quota=True,user_id='42a42cabef6949d18fca48da366bf9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:24:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151d234b-7231-4293-972b-0286246b68b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:24:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151d234b-7231-4293-972b-0286246b68b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:24:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cafa2c0-f805-4285-8c2e-cff5a2c147f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:24:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cafa2c0-f805-4285-8c2e-cff5a2c147f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd586c1d4-1264-46a3-8f95-fda1f99d33ad', 'volume_name': 'volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:24:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b620ec42-99e0-49c9-ac85-1be3170d7c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:24:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b620ec42-99e0-49c9-ac85-1be3170d7c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:24:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de2ce40-6d78-4b55-b4bf-d8f382cca35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:24:55 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Volume d586c1d4-1264-46a3-8f95-fda1f99d33ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad', 'volume_size': 1} Jun 25 17:24:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:24:55 devstack sudo[111541]: pam_unix(sudo:session): session closed for user root Jun 25 17:24:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb 1073741824" returned: 0 in 0.971s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:24:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:24:55 devstack sudo[111547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb Jun 25 17:24:55 devstack sudo[111547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:24:56 devstack sudo[111547]: pam_unix(sudo:session): session closed for user root Jun 25 17:24:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb" returned: 0 in 0.658s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:24:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:24:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:24:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.284s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:24:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1413269924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d586c1d4-1264-46a3-8f95-fda1f99d33ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0da7b9ba50a147e480d89211e28ea6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:24:55Z,use_quota=True,user_id='42a42cabef6949d18fca48da366bf9aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:24:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Creating volume d586c1d4-1264-46a3-8f95-fda1f99d33ad {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:24:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:24:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:24:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:24:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:24:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:24:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:24:56 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:24:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:24:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffdd2128-22cb-47ec-b735-9a9d18511fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:24:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24278ab1-1658-4a7e-91ed-4fee85b1b8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:24:56 devstack sudo[111550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad 1073741824 Jun 25 17:24:56 devstack sudo[111550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:24:56 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Volume volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb (0a4f27b9-c22c-4bc3-8770-73d711b3a1eb): created successfully Jun 25 17:24:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24278ab1-1658-4a7e-91ed-4fee85b1b8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:24:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Flow 'volume_create_manager' (805ab870-523a-45c7-874a-cbbbadbfe18c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:24:56 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-75098263-4873-47fe-a670-f6e95f5d18c9 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Created volume successfully. Jun 25 17:24:57 devstack sudo[111550]: pam_unix(sudo:session): session closed for user root Jun 25 17:24:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad 1073741824" returned: 0 in 0.910s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:24:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:24:57 devstack sudo[111556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad Jun 25 17:24:57 devstack sudo[111556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:24:58 devstack sudo[111556]: pam_unix(sudo:session): session closed for user root Jun 25 17:24:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad" returned: 0 in 0.761s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:24:58 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:24:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:24:58 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de2ce40-6d78-4b55-b4bf-d8f382cca35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:24:58 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a58083d7-81d2-478c-85e3-4bd937a3b55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:24:58 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Volume volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad (d586c1d4-1264-46a3-8f95-fda1f99d33ad): created successfully Jun 25 17:24:58 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a58083d7-81d2-478c-85e3-4bd937a3b55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:24:58 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Flow 'volume_create_manager' (d11593c8-586b-44f0-be1b-bae2fc49d8bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:24:58 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-1cadd0ca-b636-48d2-bede-91d7e5e2a86c tempest-TestServerVolumeAttachmentScenario-1365400553 None] Created volume successfully. Jun 25 17:25:08 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=7,cinder:SELECT=5,cinder:DELETE=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:25:08 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=4,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:25:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-6bcf17fc-acf6-4334-b962-ec90dfbc61cb req-d649705a-6b8d-4aaa-a892-5b35a903771d tempest-TestServerVolumeAttachmentScenario-1365400553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:25:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-6bcf17fc-acf6-4334-b962-ec90dfbc61cb req-d649705a-6b8d-4aaa-a892-5b35a903771d tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:25:40 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb25cb1-d748-4c7e-90b0-0e16d587d810]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:25:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-6bcf17fc-acf6-4334-b962-ec90dfbc61cb req-d649705a-6b8d-4aaa-a892-5b35a903771d tempest-TestServerVolumeAttachmentScenario-1365400553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:25:40 devstack sudo[112166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb Jun 25 17:25:40 devstack sudo[112166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:25:41 devstack sudo[112166]: pam_unix(sudo:session): session closed for user root Jun 25 17:25:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-6bcf17fc-acf6-4334-b962-ec90dfbc61cb req-d649705a-6b8d-4aaa-a892-5b35a903771d tempest-TestServerVolumeAttachmentScenario-1365400553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb" returned: 0 in 0.822s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:25:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-6bcf17fc-acf6-4334-b962-ec90dfbc61cb req-d649705a-6b8d-4aaa-a892-5b35a903771d tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.846s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:25:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-6bcf17fc-acf6-4334-b962-ec90dfbc61cb req-d649705a-6b8d-4aaa-a892-5b35a903771d tempest-TestServerVolumeAttachmentScenario-1365400553 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99e1ac64-758a-4f7c-84f7-ea6a9df4c7c5', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:25:41 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-6bcf17fc-acf6-4334-b962-ec90dfbc61cb req-d649705a-6b8d-4aaa-a892-5b35a903771d tempest-TestServerVolumeAttachmentScenario-1365400553 None] attachment_update completed successfully. Jun 25 17:25:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:25:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:25:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:25:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:25:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:25:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:25:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:25:44 devstack sudo[112557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:25:44 devstack sudo[112557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:25:44 devstack sudo[112557]: pam_unix(sudo:session): session closed for user root Jun 25 17:25:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.685s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:25:44 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:25:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:25:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 28 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:25:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:25:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-77e61344-6214-48b4-ae7d-44bba1784fd0 req-06378bc0-7b0f-4aff-8e25-441aeb5abd3e tempest-TestServerVolumeAttachmentScenario-1365400553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:25:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-77e61344-6214-48b4-ae7d-44bba1784fd0 req-06378bc0-7b0f-4aff-8e25-441aeb5abd3e tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:25:50 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a96294c-6cf9-46de-b25e-b2e51629f083]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:25:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-77e61344-6214-48b4-ae7d-44bba1784fd0 req-06378bc0-7b0f-4aff-8e25-441aeb5abd3e tempest-TestServerVolumeAttachmentScenario-1365400553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:25:50 devstack sudo[112571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad Jun 25 17:25:50 devstack sudo[112571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:25:51 devstack sudo[112571]: pam_unix(sudo:session): session closed for user root Jun 25 17:25:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-77e61344-6214-48b4-ae7d-44bba1784fd0 req-06378bc0-7b0f-4aff-8e25-441aeb5abd3e tempest-TestServerVolumeAttachmentScenario-1365400553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad" returned: 0 in 0.806s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:25:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-77e61344-6214-48b4-ae7d-44bba1784fd0 req-06378bc0-7b0f-4aff-8e25-441aeb5abd3e tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.823s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:25:51 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-77e61344-6214-48b4-ae7d-44bba1784fd0 req-06378bc0-7b0f-4aff-8e25-441aeb5abd3e tempest-TestServerVolumeAttachmentScenario-1365400553 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3af98f7b-e761-43db-b31b-bdf4605b644f', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:25:51 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-77e61344-6214-48b4-ae7d-44bba1784fd0 req-06378bc0-7b0f-4aff-8e25-441aeb5abd3e tempest-TestServerVolumeAttachmentScenario-1365400553 None] attachment_update completed successfully. Jun 25 17:25:57 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-2926684b-be77-4f05-8c3c-220afbdb315d req-ee6f3441-6e54-436c-8dc8-fb109892ac8d tempest-TestServerVolumeAttachmentScenario-1365400553 None] Terminate volume connection completed successfully. Jun 25 17:25:57 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-2926684b-be77-4f05-8c3c-220afbdb315d req-ee6f3441-6e54-436c-8dc8-fb109892ac8d tempest-TestServerVolumeAttachmentScenario-1365400553 None] Deleting attachment 3af98f7b-e761-43db-b31b-bdf4605b644f. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:26:00 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-15a96eeb-4bc8-44d9-ae10-f0d5138a84da req-99c93567-32b4-4196-a826-2b14fbf4bdea tempest-TestServerVolumeAttachmentScenario-1365400553 None] Terminate volume connection completed successfully. Jun 25 17:26:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-15a96eeb-4bc8-44d9-ae10-f0d5138a84da req-99c93567-32b4-4196-a826-2b14fbf4bdea tempest-TestServerVolumeAttachmentScenario-1365400553 None] Deleting attachment 99e1ac64-758a-4f7c-84f7-ea6a9df4c7c5. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:26:10 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=13,cinder:UPDATE=2 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:26:10 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:26:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] Acquiring lock "cinder-d586c1d4-1264-46a3-8f95-fda1f99d33ad-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:26:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "cinder-d586c1d4-1264-46a3-8f95-fda1f99d33ad-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:26:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] Acquiring lock "cinder-quobyte-d586c1d4-1264-46a3-8f95-fda1f99d33ad" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:26:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "cinder-quobyte-d586c1d4-1264-46a3-8f95-fda1f99d33ad" acquired by "delete_volume" :: waited 0.018s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:26:11 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5875f5-07ba-43f4-ad55-4edc8d636147]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:26:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:26:11 devstack sudo[112676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad Jun 25 17:26:11 devstack sudo[112676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:26:12 devstack sudo[112676]: pam_unix(sudo:session): session closed for user root Jun 25 17:26:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad" returned: 0 in 0.928s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:26:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:26:12 devstack sudo[112681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad Jun 25 17:26:12 devstack sudo[112681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:26:13 devstack sudo[112681]: pam_unix(sudo:session): session closed for user root Jun 25 17:26:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d586c1d4-1264-46a3-8f95-fda1f99d33ad" returned: 0 in 0.745s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:26:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "cinder-quobyte-d586c1d4-1264-46a3-8f95-fda1f99d33ad" released by "delete_volume" :: held 1.719s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:26:13 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] Created reservations ['62f57de7-cc71-4646-908e-09e78b36de30', '0972d853-060a-4b35-a059-1559d3e2cc5a', '1e6b9d65-eb2a-4277-bf89-968527f978d1', 'ff9217aa-b44f-442d-8787-28c6235949a9'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:26:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:26:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:26:13 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:26:13 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:26:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:26:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:26:13 devstack sudo[112684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:26:13 devstack sudo[112684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:26:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Acquiring lock "cinder-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:26:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "cinder-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:26:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Acquiring lock "cinder-quobyte-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:26:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "cinder-quobyte-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb" acquired by "delete_volume" :: waited 0.019s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:26:13 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2f36ee-d98d-4ef5-bee3-a7a9de221ff1]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:26:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:26:13 devstack sudo[112687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb Jun 25 17:26:13 devstack sudo[112687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:26:13 devstack sudo[112684]: pam_unix(sudo:session): session closed for user root Jun 25 17:26:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.698s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:26:13 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:26:13 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] Deleted volume successfully. Jun 25 17:26:14 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-95bd4468-a81c-4211-9691-ed4f2de73e1a tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "cinder-d586c1d4-1264-46a3-8f95-fda1f99d33ad-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:26:14 devstack sudo[112687]: pam_unix(sudo:session): session closed for user root Jun 25 17:26:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb" returned: 0 in 0.843s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:26:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:26:14 devstack sudo[112693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb Jun 25 17:26:14 devstack sudo[112693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:26:15 devstack sudo[112693]: pam_unix(sudo:session): session closed for user root Jun 25 17:26:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb" returned: 0 in 0.666s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:26:15 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "cinder-quobyte-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb" released by "delete_volume" :: held 1.569s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:26:15 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Created reservations ['c8c37cc1-fc5f-48dc-a7ae-4c8ac01f731a', '63d4299d-d6d0-4b80-83f0-9b44f78d4e26', '707f64bd-d99f-444c-a5f2-277fdf8a5559', '8bc2eba1-b515-4b35-bbaf-202a98ca3805'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:26:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:26:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:26:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:26:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:26:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:26:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:26:15 devstack sudo[112697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:26:15 devstack sudo[112697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:26:16 devstack sudo[112697]: pam_unix(sudo:session): session closed for user root Jun 25 17:26:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.745s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:26:16 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:26:16 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Deleted volume successfully. Jun 25 17:26:16 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b1c7d728-e42a-4fa7-b372-32a521c69570 tempest-TestServerVolumeAttachmentScenario-1365400553 None] Lock "cinder-0a4f27b9-c22c-4bc3-8770-73d711b3a1eb-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:26:25 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=9,cinder:INSERT=4,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:26:26 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=16,cinder:SELECT=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:26:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:26:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:26:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:26:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:26:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:26:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:26:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:26:44 devstack sudo[112745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:26:44 devstack sudo[112745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:26:45 devstack sudo[112745]: pam_unix(sudo:session): session closed for user root Jun 25 17:26:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.888s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:26:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:26:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:26:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 28 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:26:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:26:52 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:26:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Flow 'volume_create_manager' (01e22761-315e-425e-a77b-1fc9b4633b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:26:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890ccc7f-5a1a-4db2-ab7b-d644d0fda307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:26:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890ccc7f-5a1a-4db2-ab7b-d644d0fda307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2113673265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18fc3e98-6869-4c32-98f0-804a6dcd81a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb0803d13d048b48d79e3ac3a05fb4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:26:52Z,use_quota=True,user_id='0955b191706b432384fe08da25a3b22b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:26:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e8bdae-5dfc-4fce-8ee7-29aa5168655a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:26:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e8bdae-5dfc-4fce-8ee7-29aa5168655a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:26:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5328cfb-614b-41aa-8fe8-3fdff76e9dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:26:52 devstack cinder-volume[93869]: DEBUG cinder.image.glance [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Creating Keystone auth plugin from conf {{(pid=93869) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 17:26:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5328cfb-614b-41aa-8fe8-3fdff76e9dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '18fc3e98-6869-4c32-98f0-804a6dcd81a1', 'volume_name': 'volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1', 'volume_size': 1, 'image_id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5ca37abeabcb4631932d73e3b5ba0213', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'created_at': datetime.datetime(2026, 6, 25, 14, 55, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 14, 55, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee821749-fc82-479d-867e-eb9bd1200c86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:26:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b4ed5d-8a12-48bf-9fac-af64958d558b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:26:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b4ed5d-8a12-48bf-9fac-af64958d558b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:26:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9cbbafc-f4d6-4bd3-94c9-058ddfc4009a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:26:53 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Volume 18fc3e98-6869-4c32-98f0-804a6dcd81a1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1', 'volume_size': 1, 'image_id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5ca37abeabcb4631932d73e3b5ba0213', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'created_at': datetime.datetime(2026, 6, 25, 14, 55, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 14, 55, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee821749-fc82-479d-867e-eb9bd1200c86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 25 17:26:53 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Trying to clone 18fc3e98-6869-4c32-98f0-804a6dcd81a1 from image ee821749-fc82-479d-867e-eb9bd1200c86 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}]). {{(pid=93869) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 17:26:53 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_zvol4qi4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 17:26:53 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Image download 20.69 MB at 20.69 MB/s Jun 25 17:26:53 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ddf78a-c397-4815-9848-1989af5a48b9]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:26:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_zvol4qi4devstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:26:53 devstack sudo[112749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_zvol4qi4devstack@QuobyteHD Jun 25 17:26:53 devstack sudo[112749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:26:54 devstack sudo[112749]: pam_unix(sudo:session): session closed for user root Jun 25 17:26:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_zvol4qi4devstack@QuobyteHD" returned: 0 in 0.822s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:26:54 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Temporary image ee821749-fc82-479d-867e-eb9bd1200c86 is fetched for user 0955b191706b432384fe08da25a3b22b. {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 17:26:54 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1a02c1-4235-43e4-8d93-65ff8cd3c3b9]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:26:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_zvol4qi4devstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:26:54 devstack sudo[112755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_zvol4qi4devstack@QuobyteHD Jun 25 17:26:54 devstack sudo[112755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:26:55 devstack sudo[112755]: pam_unix(sudo:session): session closed for user root Jun 25 17:26:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_zvol4qi4devstack@QuobyteHD" returned: 0 in 0.903s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:26:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:26:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:26:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:26:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2113673265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18fc3e98-6869-4c32-98f0-804a6dcd81a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fb0803d13d048b48d79e3ac3a05fb4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:26:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:26:52Z,use_quota=True,user_id='0955b191706b432384fe08da25a3b22b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:26:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Creating volume 18fc3e98-6869-4c32-98f0-804a6dcd81a1 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:26:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:26:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:26:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:26:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:26:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:26:55 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:26:55 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:26:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:26:55 devstack sudo[112760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 1073741824 Jun 25 17:26:55 devstack sudo[112760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:26:56 devstack sudo[112760]: pam_unix(sudo:session): session closed for user root Jun 25 17:26:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 1073741824" returned: 0 in 0.955s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:26:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:26:56 devstack sudo[112766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 Jun 25 17:26:56 devstack sudo[112766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:26:56 devstack sudo[112766]: pam_unix(sudo:session): session closed for user root Jun 25 17:26:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1" returned: 0 in 0.726s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:26:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:26:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:26:56 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Attempting download of ee821749-fc82-479d-867e-eb9bd1200c86 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}])) to volume 18fc3e98-6869-4c32-98f0-804a6dcd81a1. {{(pid=93869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 17:26:57 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ddb024-256a-49d9-ac58-8d1e48acaf23]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:26:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_l1t7_zvx {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:26:57 devstack sudo[112769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_l1t7_zvx Jun 25 17:26:57 devstack sudo[112769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:26:57 devstack sudo[112769]: pam_unix(sudo:session): session closed for user root Jun 25 17:26:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_l1t7_zvx" returned: 0 in 0.818s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:26:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_l1t7_zvx {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:26:57 devstack sudo[112773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_l1t7_zvx Jun 25 17:26:57 devstack sudo[112773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:26:58 devstack sudo[112773]: pam_unix(sudo:session): session closed for user root Jun 25 17:26:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_l1t7_zvx" returned: 1 in 0.850s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:26:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee821749-fc82-479d-867e-eb9bd1200c86_l1t7_zvx' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:26:58 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a01b263-615e-4634-aa90-16de67d2df62]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:26:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_zvol4qi4devstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:26:58 devstack sudo[112777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_zvol4qi4devstack@QuobyteHD Jun 25 17:26:58 devstack sudo[112777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:26:59 devstack sudo[112777]: pam_unix(sudo:session): session closed for user root Jun 25 17:26:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_zvol4qi4devstack@QuobyteHD" returned: 0 in 0.897s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:26:59 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] ee821749-fc82-479d-867e-eb9bd1200c86 was qcow2, converting to raw {{(pid=93869) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 17:26:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_zvol4qi4devstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:26:59 devstack sudo[112788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_zvol4qi4devstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 Jun 25 17:26:59 devstack sudo[112788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:27:01 devstack sudo[112788]: pam_unix(sudo:session): session closed for user root Jun 25 17:27:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_zvol4qi4devstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1" returned: 0 in 2.267s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:27:01 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ee821749-fc82-479d-867e-eb9bd1200c86_zvol4qi4devstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:27:01 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Converted 112.00 MB image at 49.37 MB/s Jun 25 17:27:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:27:01 devstack sudo[112801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 1G Jun 25 17:27:01 devstack sudo[112801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:27:02 devstack sudo[112801]: pam_unix(sudo:session): session closed for user root Jun 25 17:27:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 1G" returned: 0 in 0.781s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:27:02 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca396703-918c-42de-b225-1d42e5230921]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:27:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:27:02 devstack sudo[112806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 Jun 25 17:27:02 devstack sudo[112806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:27:03 devstack sudo[112806]: pam_unix(sudo:session): session closed for user root Jun 25 17:27:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1" returned: 0 in 0.895s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:27:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:27:03 devstack sudo[112810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 Jun 25 17:27:03 devstack sudo[112810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:27:04 devstack sudo[112810]: pam_unix(sudo:session): session closed for user root Jun 25 17:27:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1" returned: 1 in 0.867s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:27:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:27:04 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Downloaded image ee821749-fc82-479d-867e-eb9bd1200c86 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}])) to volume 18fc3e98-6869-4c32-98f0-804a6dcd81a1 successfully. {{(pid=93869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 17:27:04 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Temporary image ee821749-fc82-479d-867e-eb9bd1200c86 for user 0955b191706b432384fe08da25a3b22b is deleted. {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 17:27:04 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Marking volume 18fc3e98-6869-4c32-98f0-804a6dcd81a1 as bootable. {{(pid=93869) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 17:27:04 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Copying metadata from image ee821749-fc82-479d-867e-eb9bd1200c86 to 18fc3e98-6869-4c32-98f0-804a6dcd81a1. {{(pid=93869) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 17:27:04 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Creating volume glance metadata for volume 18fc3e98-6869-4c32-98f0-804a6dcd81a1 backed by image ee821749-fc82-479d-867e-eb9bd1200c86 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93869) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 17:27:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9cbbafc-f4d6-4bd3-94c9-058ddfc4009a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1', 'volume_size': 1, 'image_id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee821749-fc82-479d-867e-eb9bd1200c86', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5ca37abeabcb4631932d73e3b5ba0213', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ee821749-fc82-479d-867e-eb9bd1200c86', 'created_at': datetime.datetime(2026, 6, 25, 14, 55, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 14, 55, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee821749-fc82-479d-867e-eb9bd1200c86/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:27:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bec461-0a42-4ade-899a-b758c2475265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:27:04 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Volume volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 (18fc3e98-6869-4c32-98f0-804a6dcd81a1): created successfully Jun 25 17:27:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bec461-0a42-4ade-899a-b758c2475265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:27:04 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Flow 'volume_create_manager' (01e22761-315e-425e-a77b-1fc9b4633b45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:27:04 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-8c6995c5-55e1-4c83-8cad-3908ab46aa71 tempest-TestShelveInstance-448842224 None] Created volume successfully. Jun 25 17:27:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-03fe26a7-1ed8-42bf-b239-4fa82d47fe1f req-98ad38fd-b62b-424b-96ce-b49d354923b6 tempest-TestShelveInstance-448842224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:27:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-03fe26a7-1ed8-42bf-b239-4fa82d47fe1f req-98ad38fd-b62b-424b-96ce-b49d354923b6 tempest-TestShelveInstance-448842224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:27:12 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca48a78-78b2-4448-afd0-d6ff507cc588]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:27:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-03fe26a7-1ed8-42bf-b239-4fa82d47fe1f req-98ad38fd-b62b-424b-96ce-b49d354923b6 tempest-TestShelveInstance-448842224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:27:12 devstack sudo[112831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 Jun 25 17:27:12 devstack sudo[112831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:27:13 devstack sudo[112831]: pam_unix(sudo:session): session closed for user root Jun 25 17:27:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-03fe26a7-1ed8-42bf-b239-4fa82d47fe1f req-98ad38fd-b62b-424b-96ce-b49d354923b6 tempest-TestShelveInstance-448842224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1" returned: 0 in 0.909s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:27:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-03fe26a7-1ed8-42bf-b239-4fa82d47fe1f req-98ad38fd-b62b-424b-96ce-b49d354923b6 tempest-TestShelveInstance-448842224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:27:13 devstack sudo[112836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 Jun 25 17:27:13 devstack sudo[112836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:27:14 devstack sudo[112836]: pam_unix(sudo:session): session closed for user root Jun 25 17:27:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-03fe26a7-1ed8-42bf-b239-4fa82d47fe1f req-98ad38fd-b62b-424b-96ce-b49d354923b6 tempest-TestShelveInstance-448842224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1" returned: 1 in 0.877s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:27:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-03fe26a7-1ed8-42bf-b239-4fa82d47fe1f req-98ad38fd-b62b-424b-96ce-b49d354923b6 tempest-TestShelveInstance-448842224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:27:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-03fe26a7-1ed8-42bf-b239-4fa82d47fe1f req-98ad38fd-b62b-424b-96ce-b49d354923b6 tempest-TestShelveInstance-448842224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.831s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:27:14 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-03fe26a7-1ed8-42bf-b239-4fa82d47fe1f req-98ad38fd-b62b-424b-96ce-b49d354923b6 tempest-TestShelveInstance-448842224 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4541da3-34b3-4805-bf07-aaf08595e391', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:27:14 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-03fe26a7-1ed8-42bf-b239-4fa82d47fe1f req-98ad38fd-b62b-424b-96ce-b49d354923b6 tempest-TestShelveInstance-448842224 None] attachment_update completed successfully. Jun 25 17:27:24 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:UPDATE=5,cinder:SELECT=14,cinder:INSERT=11,cinder:DELETE=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:27:24 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=17,cinder:UPDATE=8,cinder:INSERT=3 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:27:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:27:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:27:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:27:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:27:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:27:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:27:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:27:44 devstack sudo[113449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:27:44 devstack sudo[113449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:27:44 devstack sudo[113449]: pam_unix(sudo:session): session closed for user root Jun 25 17:27:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.722s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:27:44 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:27:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:27:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 28 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:27:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:27:52 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-013a84f1-6d4c-48eb-901c-8a6cb03df05e req-7bc40a65-0d7e-4e6d-8928-cd73454b60f7 tempest-TestShelveInstance-448842224 None] Terminate volume connection completed successfully. Jun 25 17:27:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-013a84f1-6d4c-48eb-901c-8a6cb03df05e req-7bc40a65-0d7e-4e6d-8928-cd73454b60f7 tempest-TestShelveInstance-448842224 None] Deleting attachment a4541da3-34b3-4805-bf07-aaf08595e391. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:27:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-a9dff998-103e-4900-81ae-cfbc09e956d5 req-06028ee8-9bc7-4a76-8672-d602ddf4698f tempest-TestShelveInstance-448842224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:27:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-a9dff998-103e-4900-81ae-cfbc09e956d5 req-06028ee8-9bc7-4a76-8672-d602ddf4698f tempest-TestShelveInstance-448842224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:27:57 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0177c4c5-1ff8-453c-98aa-ab7739bcf661]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:27:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-a9dff998-103e-4900-81ae-cfbc09e956d5 req-06028ee8-9bc7-4a76-8672-d602ddf4698f tempest-TestShelveInstance-448842224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:27:57 devstack sudo[113514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 Jun 25 17:27:57 devstack sudo[113514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:27:58 devstack sudo[113514]: pam_unix(sudo:session): session closed for user root Jun 25 17:27:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-a9dff998-103e-4900-81ae-cfbc09e956d5 req-06028ee8-9bc7-4a76-8672-d602ddf4698f tempest-TestShelveInstance-448842224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1" returned: 0 in 0.854s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:27:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-a9dff998-103e-4900-81ae-cfbc09e956d5 req-06028ee8-9bc7-4a76-8672-d602ddf4698f tempest-TestShelveInstance-448842224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:27:58 devstack sudo[113518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 Jun 25 17:27:58 devstack sudo[113518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:27:59 devstack sudo[113518]: pam_unix(sudo:session): session closed for user root Jun 25 17:27:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-a9dff998-103e-4900-81ae-cfbc09e956d5 req-06028ee8-9bc7-4a76-8672-d602ddf4698f tempest-TestShelveInstance-448842224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1" returned: 1 in 0.821s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:27:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-a9dff998-103e-4900-81ae-cfbc09e956d5 req-06028ee8-9bc7-4a76-8672-d602ddf4698f tempest-TestShelveInstance-448842224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:27:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-a9dff998-103e-4900-81ae-cfbc09e956d5 req-06028ee8-9bc7-4a76-8672-d602ddf4698f tempest-TestShelveInstance-448842224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.717s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:27:59 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-a9dff998-103e-4900-81ae-cfbc09e956d5 req-06028ee8-9bc7-4a76-8672-d602ddf4698f tempest-TestShelveInstance-448842224 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868', 'name': 'volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92c449b7-18ef-47b9-9be2-7deeea532a0d', 'enforce_multipath': True} {{(pid=93869) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 25 17:27:59 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-a9dff998-103e-4900-81ae-cfbc09e956d5 req-06028ee8-9bc7-4a76-8672-d602ddf4698f tempest-TestShelveInstance-448842224 None] attachment_update completed successfully. Jun 25 17:28:09 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:28:09 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:28:37 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-ba614f58-146d-4474-9c9d-03d23e1a61c1 tempest-TestShelveInstance-448842224 None] Terminate volume connection completed successfully. Jun 25 17:28:37 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-ba614f58-146d-4474-9c9d-03d23e1a61c1 tempest-TestShelveInstance-448842224 None] Deleting attachment 92c449b7-18ef-47b9-9be2-7deeea532a0d. {{(pid=93869) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 25 17:28:38 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] Acquiring lock "cinder-18fc3e98-6869-4c32-98f0-804a6dcd81a1-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:28:38 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] Lock "cinder-18fc3e98-6869-4c32-98f0-804a6dcd81a1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:28:38 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] Acquiring lock "cinder-quobyte-18fc3e98-6869-4c32-98f0-804a6dcd81a1" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:28:38 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] Lock "cinder-quobyte-18fc3e98-6869-4c32-98f0-804a6dcd81a1" acquired by "delete_volume" :: waited 0.017s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:28:38 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[341f16da-9bb4-47d6-8e06-63f2df3983e8]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:28:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:28:38 devstack sudo[114122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 Jun 25 17:28:38 devstack sudo[114122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:28:39 devstack sudo[114122]: pam_unix(sudo:session): session closed for user root Jun 25 17:28:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1" returned: 0 in 0.876s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:28:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:28:39 devstack sudo[114126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 Jun 25 17:28:39 devstack sudo[114126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:28:40 devstack sudo[114126]: pam_unix(sudo:session): session closed for user root Jun 25 17:28:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1" returned: 1 in 0.797s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:28:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:28:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:28:40 devstack sudo[114131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1 Jun 25 17:28:40 devstack sudo[114131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:28:40 devstack sudo[114131]: pam_unix(sudo:session): session closed for user root Jun 25 17:28:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-18fc3e98-6869-4c32-98f0-804a6dcd81a1" returned: 0 in 0.716s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:28:40 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] Lock "cinder-quobyte-18fc3e98-6869-4c32-98f0-804a6dcd81a1" released by "delete_volume" :: held 2.468s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:28:40 devstack cinder-volume[93869]: DEBUG cinder.quota [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] Created reservations ['b73bb4e8-274d-4337-bf94-e7d280d763c8', '09494779-bcbd-41de-8891-e252dd2b5d07', 'ab956ae4-1bcf-4b93-838b-dbb9fe7dc75d', '487d95d8-3983-4e76-b9a5-e76c402b9e52'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:28:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:28:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:28:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:28:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:28:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:28:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:28:41 devstack sudo[114134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:28:41 devstack sudo[114134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:28:41 devstack sudo[114134]: pam_unix(sudo:session): session closed for user root Jun 25 17:28:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.742s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:28:41 devstack cinder-volume[93869]: DEBUG cinder.manager [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:28:41 devstack cinder-volume[93869]: INFO cinder.volume.manager [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] Deleted volume successfully. Jun 25 17:28:41 devstack cinder-volume[93869]: DEBUG cinder.coordination [req-a5f86fcf-69a5-46ab-b146-04782980a806 req-b13f44e5-9d4b-483c-aaa5-58813a9b39ea tempest-TestShelveInstance-448842224 None] Lock "cinder-18fc3e98-6869-4c32-98f0-804a6dcd81a1-delete_volume" released by "delete_volume" :: held 3.433s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:28:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:28:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:28:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:28:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:28:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:28:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:28:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:28:44 devstack sudo[114139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:28:44 devstack sudo[114139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:28:44 devstack sudo[114139]: pam_unix(sudo:session): session closed for user root Jun 25 17:28:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.723s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:28:44 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:28:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:28:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 28 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:28:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:28:55 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:28:55 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:28:56 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:28:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Flow 'volume_create_manager' (70ee2bcd-9788-41a4-8336-efe35321d27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:28:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f276f5b2-c4ed-496a-9b29-78efac9f9b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:28:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f276f5b2-c4ed-496a-9b29-78efac9f9b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4eec7d8c3449eaa07226509baab650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:28:56Z,use_quota=True,user_id='af0e63ae775747ccb17617a4497a9661',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cd10716-465c-4e7d-ba80-06b4032b1253),volume_type_id=0cd10716-465c-4e7d-ba80-06b4032b1253)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:28:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10222273-7d33-4a54-ac79-2af8b4ec3fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:28:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10222273-7d33-4a54-ac79-2af8b4ec3fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:28:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84a6a97-79b4-4310-8b0c-d33f8c10d9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:28:56 devstack cinder-volume[93869]: DEBUG cinder.image.glance [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Creating Keystone auth plugin from conf {{(pid=93869) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 17:28:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84a6a97-79b4-4310-8b0c-d33f8c10d9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c', 'volume_name': 'volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c', 'volume_size': 1, 'image_id': '1238d108-8d57-4d51-93ea-66034e3a917d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1238d108-8d57-4d51-93ea-66034e3a917d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f0ac63b237d075d6796aab797a44740', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a4eec7d8c3449eaa07226509baab650', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '33b516d61b0d74d901d72c99dea96bb8d8dad617354d039297b1503823be02e7a26965d5a85d87f1192a1e0a26c87a7af1428436b00cbbf55b57f376138deb3d', 'id': '1238d108-8d57-4d51-93ea-66034e3a917d', 'created_at': datetime.datetime(2026, 6, 25, 15, 28, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 28, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1238d108-8d57-4d51-93ea-66034e3a917d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:28:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a7d8c9-bc02-4cb4-a91e-450898645c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:28:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a7d8c9-bc02-4cb4-a91e-450898645c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:28:56 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f97bec-8c19-4240-9a91-62fe90777a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:28:56 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Volume 2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c', 'volume_size': 1, 'image_id': '1238d108-8d57-4d51-93ea-66034e3a917d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1238d108-8d57-4d51-93ea-66034e3a917d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f0ac63b237d075d6796aab797a44740', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a4eec7d8c3449eaa07226509baab650', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '33b516d61b0d74d901d72c99dea96bb8d8dad617354d039297b1503823be02e7a26965d5a85d87f1192a1e0a26c87a7af1428436b00cbbf55b57f376138deb3d', 'id': '1238d108-8d57-4d51-93ea-66034e3a917d', 'created_at': datetime.datetime(2026, 6, 25, 15, 28, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 28, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1238d108-8d57-4d51-93ea-66034e3a917d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 25 17:28:56 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Trying to clone 2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c from image 1238d108-8d57-4d51-93ea-66034e3a917d at location (None, [{'url': 'file:///opt/stack/data/glance/images/1238d108-8d57-4d51-93ea-66034e3a917d', 'metadata': {}}]). {{(pid=93869) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 17:28:56 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 17:28:56 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Image download 0.00 MB at 0.00 MB/s Jun 25 17:28:56 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f46b18-6e7f-4b6a-aa86-1d14c4af1ef7]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:28:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:28:56 devstack sudo[114146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD Jun 25 17:28:56 devstack sudo[114146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:28:57 devstack sudo[114146]: pam_unix(sudo:session): session closed for user root Jun 25 17:28:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD" returned: 0 in 0.772s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:28:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:28:57 devstack sudo[114150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD Jun 25 17:28:57 devstack sudo[114150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:28:58 devstack sudo[114150]: pam_unix(sudo:session): session closed for user root Jun 25 17:28:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD" returned: 1 in 0.710s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:28:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:28:58 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Temporary image 1238d108-8d57-4d51-93ea-66034e3a917d is fetched for user af0e63ae775747ccb17617a4497a9661. {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 17:28:58 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ed4f4e-73ab-4216-8080-5ca9c5e28a95]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:28:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:28:58 devstack sudo[114155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD Jun 25 17:28:58 devstack sudo[114155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:28:58 devstack sudo[114155]: pam_unix(sudo:session): session closed for user root Jun 25 17:28:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD" returned: 0 in 0.721s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:28:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:28:59 devstack sudo[114159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD Jun 25 17:28:59 devstack sudo[114159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:28:59 devstack sudo[114159]: pam_unix(sudo:session): session closed for user root Jun 25 17:28:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD" returned: 1 in 0.782s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:28:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:28:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:28:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:28:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4eec7d8c3449eaa07226509baab650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:28:56Z,use_quota=True,user_id='af0e63ae775747ccb17617a4497a9661',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cd10716-465c-4e7d-ba80-06b4032b1253),volume_type_id=0cd10716-465c-4e7d-ba80-06b4032b1253)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:28:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Creating volume 2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:28:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:28:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:28:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:28:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:28:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:28:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:28:59 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:28:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:28:59 devstack sudo[114170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c 1073741824 Jun 25 17:28:59 devstack sudo[114170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:00 devstack sudo[114170]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c 1073741824" returned: 0 in 0.824s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:00 devstack sudo[114176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c Jun 25 17:29:00 devstack sudo[114176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:01 devstack sudo[114176]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c" returned: 0 in 0.662s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:29:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:01 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Attempting download of 1238d108-8d57-4d51-93ea-66034e3a917d ((None, [{'url': 'file:///opt/stack/data/glance/images/1238d108-8d57-4d51-93ea-66034e3a917d', 'metadata': {}}])) to volume 2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c. {{(pid=93869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 17:29:01 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62140f6-e036-4556-9bff-2d359925e411]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:29:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1238d108-8d57-4d51-93ea-66034e3a917d_b00vs2_c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:01 devstack sudo[114179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1238d108-8d57-4d51-93ea-66034e3a917d_b00vs2_c Jun 25 17:29:01 devstack sudo[114179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:02 devstack sudo[114179]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1238d108-8d57-4d51-93ea-66034e3a917d_b00vs2_c" returned: 0 in 0.786s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1238d108-8d57-4d51-93ea-66034e3a917d_b00vs2_c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:02 devstack sudo[114185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1238d108-8d57-4d51-93ea-66034e3a917d_b00vs2_c Jun 25 17:29:02 devstack sudo[114185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:02 devstack sudo[114185]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1238d108-8d57-4d51-93ea-66034e3a917d_b00vs2_c" returned: 1 in 0.761s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1238d108-8d57-4d51-93ea-66034e3a917d_b00vs2_c' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:29:02 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3937a79f-dc7d-41d9-83ff-e67674374ea6]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:29:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:03 devstack sudo[114189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD Jun 25 17:29:03 devstack sudo[114189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:03 devstack sudo[114189]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD" returned: 0 in 0.786s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:03 devstack sudo[114193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD Jun 25 17:29:03 devstack sudo[114193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:04 devstack sudo[114193]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD" returned: 1 in 0.753s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:29:04 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] 1238d108-8d57-4d51-93ea-66034e3a917d was raw, converting to raw {{(pid=93869) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 17:29:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:04 devstack sudo[114199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c Jun 25 17:29:04 devstack sudo[114199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:05 devstack sudo[114199]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c" returned: 0 in 0.765s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:05 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1238d108-8d57-4d51-93ea-66034e3a917d_q8_e8ja3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:29:05 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Converted 0.00 MB image at 0.00 MB/s Jun 25 17:29:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:05 devstack sudo[114204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c 1G Jun 25 17:29:05 devstack sudo[114204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:05 devstack sudo[114204]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c 1G" returned: 0 in 0.735s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:06 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[73538940-beea-4920-bf00-93a018a3beac]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:29:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:06 devstack sudo[114209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c Jun 25 17:29:06 devstack sudo[114209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:06 devstack sudo[114209]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c" returned: 0 in 0.767s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:06 devstack sudo[114213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c Jun 25 17:29:06 devstack sudo[114213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:07 devstack sudo[114213]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c" returned: 1 in 0.727s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:29:07 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Downloaded image 1238d108-8d57-4d51-93ea-66034e3a917d ((None, [{'url': 'file:///opt/stack/data/glance/images/1238d108-8d57-4d51-93ea-66034e3a917d', 'metadata': {}}])) to volume 2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c successfully. {{(pid=93869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 17:29:07 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Temporary image 1238d108-8d57-4d51-93ea-66034e3a917d for user af0e63ae775747ccb17617a4497a9661 is deleted. {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 17:29:07 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Marking volume 2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c as bootable. {{(pid=93869) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 17:29:07 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Copying metadata from image 1238d108-8d57-4d51-93ea-66034e3a917d to 2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c. {{(pid=93869) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 17:29:07 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Creating volume glance metadata for volume 2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c backed by image 1238d108-8d57-4d51-93ea-66034e3a917d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1238d108-8d57-4d51-93ea-66034e3a917d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8f0ac63b237d075d6796aab797a44740', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93869) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 17:29:08 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f97bec-8c19-4240-9a91-62fe90777a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c', 'volume_size': 1, 'image_id': '1238d108-8d57-4d51-93ea-66034e3a917d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1238d108-8d57-4d51-93ea-66034e3a917d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f0ac63b237d075d6796aab797a44740', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a4eec7d8c3449eaa07226509baab650', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '33b516d61b0d74d901d72c99dea96bb8d8dad617354d039297b1503823be02e7a26965d5a85d87f1192a1e0a26c87a7af1428436b00cbbf55b57f376138deb3d', 'id': '1238d108-8d57-4d51-93ea-66034e3a917d', 'created_at': datetime.datetime(2026, 6, 25, 15, 28, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 28, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1238d108-8d57-4d51-93ea-66034e3a917d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:08 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f25d62-7c2f-4ba2-abcf-e1a181c36c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:09 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Volume volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c (2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c): created successfully Jun 25 17:29:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f25d62-7c2f-4ba2-abcf-e1a181c36c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Flow 'volume_create_manager' (70ee2bcd-9788-41a4-8336-efe35321d27a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:10 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-05ad3851-c779-43b9-8517-abf6b4801634 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Created volume successfully. Jun 25 17:29:12 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Acquiring lock "cinder-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:29:12 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Lock "cinder-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:29:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Acquiring lock "cinder-quobyte-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:29:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Lock "cinder-quobyte-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c" acquired by "delete_volume" :: waited 0.019s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:29:13 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccebf7d0-b20d-46b2-b9ef-8573229e1d9a]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:29:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:13 devstack sudo[114219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c Jun 25 17:29:13 devstack sudo[114219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:13 devstack sudo[114219]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c" returned: 0 in 0.779s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:14 devstack sudo[114224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c Jun 25 17:29:14 devstack sudo[114224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:14 devstack sudo[114224]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c" returned: 1 in 0.777s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:29:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:14 devstack sudo[114229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c Jun 25 17:29:14 devstack sudo[114229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:15 devstack sudo[114229]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c" returned: 0 in 0.704s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:15 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Lock "cinder-quobyte-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c" released by "delete_volume" :: held 2.327s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:29:15 devstack cinder-volume[93869]: WARNING cinder.quota [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:29:15 devstack cinder-volume[93869]: WARNING cinder.quota [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 25 17:29:15 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Created reservations ['53d3f8c8-e899-4c1d-8b0f-35d92555228a', '73142f75-0ae6-45ab-8b7d-695e1f1451d0', '5e909c31-b579-4842-8581-396e4f9e0076', 'c7149e2a-4694-464c-8aa1-28bd84a8eb41'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:29:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:29:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:29:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:15 devstack sudo[114233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:29:15 devstack sudo[114233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:16 devstack sudo[114233]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.639s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:16 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:29:16 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Deleted volume successfully. Jun 25 17:29:16 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c7408670-19d9-455b-8d9b-93b92a000ac3 tempest-VolumeAndVolumeTypeFromImageTest-1195897274 None] Lock "cinder-2ac2f163-6a4a-4f48-8c0f-bd7b8182d87c-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:29:25 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=14,cinder:INSERT=10,cinder:UPDATE=13 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:29:26 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=12,cinder:UPDATE=12,cinder:INSERT=5,cinder:DELETE=2 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:29:30 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:29:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Flow 'volume_create_manager' (a101dd81-cfab-4f0b-8891-d4c20bf83dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1896a9-607e-4c37-964f-023d229f9b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:30 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:29:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Flow 'volume_create_manager' (1626afdb-441e-4921-85f4-6a28e3030478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4fa434-c7c6-4721-90b5-6927adf80dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1896a9-607e-4c37-964f-023d229f9b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1172302222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=725acb90-0861-4e15-855b-08c4505e639c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3b0db03227495c9ffd2eb6d8aa1f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:31Z,use_quota=True,user_id='933cba04e0f540acaf5aba81ce64a03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a86319-d667-47d9-9c45-5709aed7822d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a86319-d667-47d9-9c45-5709aed7822d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:30 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef59434b-2753-4661-a828-1e61d0fecfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef59434b-2753-4661-a828-1e61d0fecfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '725acb90-0861-4e15-855b-08c4505e639c', 'volume_name': 'volume-725acb90-0861-4e15-855b-08c4505e639c', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0217d13-1d06-4001-a577-8b4a5bc3cde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0217d13-1d06-4001-a577-8b4a5bc3cde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4ac8f2-56ec-469c-bdc2-6e80ec0f1d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Volume 725acb90-0861-4e15-855b-08c4505e639c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-725acb90-0861-4e15-855b-08c4505e639c', 'volume_size': 1} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1172302222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=725acb90-0861-4e15-855b-08c4505e639c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3b0db03227495c9ffd2eb6d8aa1f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:31Z,use_quota=True,user_id='933cba04e0f540acaf5aba81ce64a03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Creating volume 725acb90-0861-4e15-855b-08c4505e639c {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:29:31 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4fa434-c7c6-4721-90b5-6927adf80dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-857186454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e9466e-8d6f-45ca-befb-cb17e246c68b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a2b647f85c4059b024d208d167f035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:31Z,use_quota=True,user_id='d03b72014103453697c894fc58cf8534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:31 devstack sudo[114280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c 1073741824 Jun 25 17:29:31 devstack sudo[114280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a63031-bb00-4b51-bb87-65f1121eaf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a63031-bb00-4b51-bb87-65f1121eaf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fcfcb46-190a-4974-8215-c03e4341c4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fcfcb46-190a-4974-8215-c03e4341c4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32e9466e-8d6f-45ca-befb-cb17e246c68b', 'volume_name': 'volume-32e9466e-8d6f-45ca-befb-cb17e246c68b', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccdb698d-3eeb-4cf1-a59b-e64d11344a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccdb698d-3eeb-4cf1-a59b-e64d11344a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee37c15e-131a-409e-8c48-759099d329c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Volume 32e9466e-8d6f-45ca-befb-cb17e246c68b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32e9466e-8d6f-45ca-befb-cb17e246c68b', 'volume_size': 1} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Flow 'volume_create_manager' (061d4a59-b46e-4605-beac-e84b30a37030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bddb4f95-37e2-4b26-95a0-dd4796c30a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bddb4f95-37e2-4b26-95a0-dd4796c30a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1852782823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e27930-56cf-43e8-bb2e-5b77b7aa7309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a2b647f85c4059b024d208d167f035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:31Z,use_quota=True,user_id='d03b72014103453697c894fc58cf8534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dce755a-4640-4e0a-aee5-8131558c6177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dce755a-4640-4e0a-aee5-8131558c6177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223b8386-9498-4f0d-8cb0-95e277945187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (223b8386-9498-4f0d-8cb0-95e277945187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08e27930-56cf-43e8-bb2e-5b77b7aa7309', 'volume_name': 'volume-08e27930-56cf-43e8-bb2e-5b77b7aa7309', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0277d0-3541-4a99-baca-d0b32791fc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0277d0-3541-4a99-baca-d0b32791fc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79aa5875-51ee-47b1-9a8b-d1c88b7e4cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Volume 08e27930-56cf-43e8-bb2e-5b77b7aa7309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08e27930-56cf-43e8-bb2e-5b77b7aa7309', 'volume_size': 1} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Flow 'volume_create_manager' (91827d55-6b18-4b21-b1ba-4ef6efeb2fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2544dba7-5ff4-4bee-9d79-2a995e66b928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2544dba7-5ff4-4bee-9d79-2a995e66b928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1197244190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88ca21b-011f-4ba2-afc1-f5db5088c9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e368e00893514fd3a8510dd9ca3c1c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:31Z,use_quota=True,user_id='7d7e8cd747e142dda1287279e4c6fb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c44574e-ae83-475f-8583-276195099601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c44574e-ae83-475f-8583-276195099601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (831009dc-3904-43af-b14e-16716b8e82e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (831009dc-3904-43af-b14e-16716b8e82e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e88ca21b-011f-4ba2-afc1-f5db5088c9b9', 'volume_name': 'volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6fb532-c8ca-4fbc-bd8f-6421507f49e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6fb532-c8ca-4fbc-bd8f-6421507f49e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3604136-93c5-4ec4-b38a-ccab49c85236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Volume e88ca21b-011f-4ba2-afc1-f5db5088c9b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9', 'volume_size': 1} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Flow 'volume_create_manager' (28011340-e647-4af2-a0de-3dac6a6e7014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc86f776-761e-417e-967e-86cd24c232c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc86f776-761e-417e-967e-86cd24c232c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-205950189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9612457-88a7-4b1c-8a55-b03a70c846e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a2b647f85c4059b024d208d167f035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:32Z,use_quota=True,user_id='d03b72014103453697c894fc58cf8534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab0d225-4255-49aa-8d21-9efdb7ba5567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eab0d225-4255-49aa-8d21-9efdb7ba5567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a43edd-5c08-4bfd-9f58-8b010d8efa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a43edd-5c08-4bfd-9f58-8b010d8efa32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9612457-88a7-4b1c-8a55-b03a70c846e3', 'volume_name': 'volume-d9612457-88a7-4b1c-8a55-b03a70c846e3', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b48aace-5b3e-4ff1-a256-0adf6274f3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b48aace-5b3e-4ff1-a256-0adf6274f3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abcbe08c-760a-4ee7-8513-d9069058636e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:31 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Volume d9612457-88a7-4b1c-8a55-b03a70c846e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9612457-88a7-4b1c-8a55-b03a70c846e3', 'volume_size': 1} Jun 25 17:29:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Flow 'volume_create_manager' (509c324e-3a99-48dd-9a38-e6ee28f60624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70bdd6bd-5706-4f5c-b834-c6ab1ae9233b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:32 devstack sudo[114280]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70bdd6bd-5706-4f5c-b834-c6ab1ae9233b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-924764676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40edacbf-9446-4116-b0f6-be68d87294c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a2b647f85c4059b024d208d167f035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:32Z,use_quota=True,user_id='d03b72014103453697c894fc58cf8534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3bfc4f3-a4e4-4e09-b840-2e3bfc9c3585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3bfc4f3-a4e4-4e09-b840-2e3bfc9c3585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950776ef-0a0d-4311-9f93-e07e63169f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950776ef-0a0d-4311-9f93-e07e63169f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40edacbf-9446-4116-b0f6-be68d87294c0', 'volume_name': 'volume-40edacbf-9446-4116-b0f6-be68d87294c0', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859f29af-6497-4a91-b939-fa402f861d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (859f29af-6497-4a91-b939-fa402f861d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d37c70ed-8f9f-4942-b8ef-2548c677fb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:32 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Volume 40edacbf-9446-4116-b0f6-be68d87294c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40edacbf-9446-4116-b0f6-be68d87294c0', 'volume_size': 1} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c 1073741824" returned: 0 in 1.369s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:32 devstack sudo[114287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c Jun 25 17:29:32 devstack sudo[114287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Flow 'volume_create_manager' (317b8a54-5c84-4b74-b493-16080bdbbd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0776e600-cbb4-4465-b3fd-faa3b0d4aa0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0776e600-cbb4-4465-b3fd-faa3b0d4aa0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1712649911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03cf88a-580e-4a99-8265-0176117f852d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a2b647f85c4059b024d208d167f035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:33Z,use_quota=True,user_id='d03b72014103453697c894fc58cf8534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98fe5f1-56d6-4ad8-95ca-907735213914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b98fe5f1-56d6-4ad8-95ca-907735213914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4257a350-a7ab-4974-84b2-8410acd86170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4257a350-a7ab-4974-84b2-8410acd86170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c03cf88a-580e-4a99-8265-0176117f852d', 'volume_name': 'volume-c03cf88a-580e-4a99-8265-0176117f852d', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f727aa5-f689-4dcd-953f-c259ba4ccb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f727aa5-f689-4dcd-953f-c259ba4ccb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28c763c-a2ab-4b2a-bae5-1fb0e3b33d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:32 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Volume c03cf88a-580e-4a99-8265-0176117f852d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c03cf88a-580e-4a99-8265-0176117f852d', 'volume_size': 1} Jun 25 17:29:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:33 devstack sudo[114287]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c" returned: 0 in 0.691s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:33 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] <== create_volume: return (2111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:29:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.020s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:33 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-857186454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e9466e-8d6f-45ca-befb-cb17e246c68b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a2b647f85c4059b024d208d167f035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:31Z,use_quota=True,user_id='d03b72014103453697c894fc58cf8534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:29:33 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Creating volume 32e9466e-8d6f-45ca-befb-cb17e246c68b {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:29:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:33 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:29:33 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:29:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:33 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:29:33 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:29:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32e9466e-8d6f-45ca-befb-cb17e246c68b 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e4ac8f2-56ec-469c-bdc2-6e80ec0f1d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-725acb90-0861-4e15-855b-08c4505e639c', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:33 devstack sudo[114290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32e9466e-8d6f-45ca-befb-cb17e246c68b 1073741824 Jun 25 17:29:33 devstack sudo[114290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57cdd339-9f5d-4fdb-af66-f9d5bcd2a58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:33 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Volume volume-725acb90-0861-4e15-855b-08c4505e639c (725acb90-0861-4e15-855b-08c4505e639c): created successfully Jun 25 17:29:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57cdd339-9f5d-4fdb-af66-f9d5bcd2a58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:33 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Flow 'volume_create_manager' (a101dd81-cfab-4f0b-8891-d4c20bf83dbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:33 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-92c1ccf8-b1a8-41c5-9136-984b8da08267 tempest-CreateVolumesFromSnapshotTest-615178772 None] Created volume successfully. Jun 25 17:29:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-468b1b07-b731-4007-978a-e6d8c862b8ff tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:34 devstack sudo[114290]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32e9466e-8d6f-45ca-befb-cb17e246c68b 1073741824" returned: 0 in 1.003s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32e9466e-8d6f-45ca-befb-cb17e246c68b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:34 devstack sudo[114297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32e9466e-8d6f-45ca-befb-cb17e246c68b Jun 25 17:29:34 devstack sudo[114297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Flow 'volume_create_manager' (c266383e-223e-49ca-98e0-01b73984d9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc90227-9628-4d5a-bff9-eaabb4358dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc90227-9628-4d5a-bff9-eaabb4358dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e594d18132a946bebca6e7f7687bceda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:35Z,use_quota=True,user_id='ef423441f715452bb3b7cbe9ca8c97b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d458cf8d-3e40-4a0c-bf0e-5f80fd1041ea),volume_type_id=d458cf8d-3e40-4a0c-bf0e-5f80fd1041ea)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca31e6d-8906-4661-8220-ae2b5d69d536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eca31e6d-8906-4661-8220-ae2b5d69d536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f487dcc-d330-42e0-8371-f3fe0b2cdc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG cinder.image.glance [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Creating Keystone auth plugin from conf {{(pid=93869) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 17:29:34 devstack sudo[114297]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32e9466e-8d6f-45ca-befb-cb17e246c68b" returned: 0 in 0.729s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.298s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1852782823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08e27930-56cf-43e8-bb2e-5b77b7aa7309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a2b647f85c4059b024d208d167f035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:31Z,use_quota=True,user_id='d03b72014103453697c894fc58cf8534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Creating volume 08e27930-56cf-43e8-bb2e-5b77b7aa7309 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:29:34 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-08e27930-56cf-43e8-bb2e-5b77b7aa7309 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:34 devstack sudo[114300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-08e27930-56cf-43e8-bb2e-5b77b7aa7309 1073741824 Jun 25 17:29:34 devstack sudo[114300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee37c15e-131a-409e-8c48-759099d329c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32e9466e-8d6f-45ca-befb-cb17e246c68b', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:34 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b535a12c-b071-4a68-a280-02a9e6c29e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:35 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Volume volume-32e9466e-8d6f-45ca-befb-cb17e246c68b (32e9466e-8d6f-45ca-befb-cb17e246c68b): created successfully Jun 25 17:29:35 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b535a12c-b071-4a68-a280-02a9e6c29e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:35 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Flow 'volume_create_manager' (1626afdb-441e-4921-85f4-6a28e3030478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:35 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-eee1e20e-7cae-4607-97a8-14518f0db811 tempest-CreateVolumesFromImageTest-1860393279 None] Created volume successfully. Jun 25 17:29:35 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f487dcc-d330-42e0-8371-f3fe0b2cdc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4', 'volume_name': 'volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4', 'volume_size': 1, 'image_id': 'd409c8d1-da57-4c0c-85cd-f3c403412ddb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d409c8d1-da57-4c0c-85cd-f3c403412ddb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c5b5c3fc53726f1f12842e16095b426', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e594d18132a946bebca6e7f7687bceda', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd61b1132e3933d0d31aaf640e967a16544505a16ecc3d26d921318e449facb7c5a21c7d4229d12c561a6024086abc25a10916afd5055928e36ad051020ecb3fa', 'id': 'd409c8d1-da57-4c0c-85cd-f3c403412ddb', 'created_at': datetime.datetime(2026, 6, 25, 15, 29, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d409c8d1-da57-4c0c-85cd-f3c403412ddb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:35 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65c2d3a-ef13-4ffa-bf52-4918404d3cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:35 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65c2d3a-ef13-4ffa-bf52-4918404d3cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:35 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89192d69-02a6-4d85-bd12-5118e054df41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:35 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Volume 2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4', 'volume_size': 1, 'image_id': 'd409c8d1-da57-4c0c-85cd-f3c403412ddb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d409c8d1-da57-4c0c-85cd-f3c403412ddb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c5b5c3fc53726f1f12842e16095b426', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e594d18132a946bebca6e7f7687bceda', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd61b1132e3933d0d31aaf640e967a16544505a16ecc3d26d921318e449facb7c5a21c7d4229d12c561a6024086abc25a10916afd5055928e36ad051020ecb3fa', 'id': 'd409c8d1-da57-4c0c-85cd-f3c403412ddb', 'created_at': datetime.datetime(2026, 6, 25, 15, 29, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d409c8d1-da57-4c0c-85cd-f3c403412ddb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 25 17:29:35 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Trying to clone 2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 from image d409c8d1-da57-4c0c-85cd-f3c403412ddb at location (None, [{'url': 'file:///opt/stack/data/glance/images/d409c8d1-da57-4c0c-85cd-f3c403412ddb', 'metadata': {}}]). {{(pid=93869) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 17:29:35 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 17:29:35 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Image download 0.00 MB at 0.00 MB/s Jun 25 17:29:35 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e5505e-cb04-4dfa-9c5e-824565c32a3e]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:29:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:35 devstack sudo[114302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD Jun 25 17:29:35 devstack sudo[114302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:35 devstack sudo[114300]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-08e27930-56cf-43e8-bb2e-5b77b7aa7309 1073741824" returned: 0 in 0.924s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-08e27930-56cf-43e8-bb2e-5b77b7aa7309 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:35 devstack sudo[114308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-08e27930-56cf-43e8-bb2e-5b77b7aa7309 Jun 25 17:29:35 devstack sudo[114308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:36 devstack sudo[114302]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD" returned: 0 in 0.789s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:36 devstack sudo[114312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD Jun 25 17:29:36 devstack sudo[114312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:36 devstack sudo[114308]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-08e27930-56cf-43e8-bb2e-5b77b7aa7309" returned: 0 in 0.671s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.856s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1197244190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e88ca21b-011f-4ba2-afc1-f5db5088c9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e368e00893514fd3a8510dd9ca3c1c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:31Z,use_quota=True,user_id='7d7e8cd747e142dda1287279e4c6fb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Creating volume e88ca21b-011f-4ba2-afc1-f5db5088c9b9 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:29:36 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79aa5875-51ee-47b1-9a8b-d1c88b7e4cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08e27930-56cf-43e8-bb2e-5b77b7aa7309', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:36 devstack sudo[114315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 1073741824 Jun 25 17:29:36 devstack sudo[114315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab69513-3e50-47b8-82ab-f2ef3d06770b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:36 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Volume volume-08e27930-56cf-43e8-bb2e-5b77b7aa7309 (08e27930-56cf-43e8-bb2e-5b77b7aa7309): created successfully Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab69513-3e50-47b8-82ab-f2ef3d06770b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Flow 'volume_create_manager' (061d4a59-b46e-4605-beac-e84b30a37030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:36 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-4a163f70-92e4-4114-a5d4-c4e7e14a1bba tempest-CreateVolumesFromImageTest-1860393279 None] Created volume successfully. Jun 25 17:29:36 devstack sudo[114312]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD" returned: 1 in 0.753s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Temporary image d409c8d1-da57-4c0c-85cd-f3c403412ddb is fetched for user ef423441f715452bb3b7cbe9ca8c97b5. {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3522af7-1561-46ea-8cca-7f9e111aa794]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:29:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:37 devstack sudo[114320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD Jun 25 17:29:37 devstack sudo[114320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:37 devstack sudo[114315]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 1073741824" returned: 0 in 0.924s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:37 devstack sudo[114325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 Jun 25 17:29:37 devstack sudo[114325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:37 devstack sudo[114320]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD" returned: 0 in 0.798s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:37 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:37 devstack sudo[114363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD Jun 25 17:29:37 devstack sudo[114363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:38 devstack sudo[114325]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9" returned: 0 in 0.684s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.337s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-205950189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9612457-88a7-4b1c-8a55-b03a70c846e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a2b647f85c4059b024d208d167f035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:32Z,use_quota=True,user_id='d03b72014103453697c894fc58cf8534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Creating volume d9612457-88a7-4b1c-8a55-b03a70c846e3 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:29:38 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9612457-88a7-4b1c-8a55-b03a70c846e3 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3604136-93c5-4ec4-b38a-ccab49c85236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:38 devstack sudo[114368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9612457-88a7-4b1c-8a55-b03a70c846e3 1073741824 Jun 25 17:29:38 devstack sudo[114368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0619b8e-23c8-4215-bbc5-0975b9a215c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:38 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Volume volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 (e88ca21b-011f-4ba2-afc1-f5db5088c9b9): created successfully Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0619b8e-23c8-4215-bbc5-0975b9a215c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Flow 'volume_create_manager' (91827d55-6b18-4b21-b1ba-4ef6efeb2fb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:38 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-9cba46d8-1891-4bbb-957d-eeb67c08e45c tempest-VolumeDependencyTests-1907395917 None] Created volume successfully. Jun 25 17:29:38 devstack sudo[114363]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD" returned: 1 in 0.830s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5512a2e8-d684-49a9-b3d6-ce360f766085 tempest-VolumeDependencyTests-1907395917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:39 devstack sudo[114368]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9612457-88a7-4b1c-8a55-b03a70c846e3 1073741824" returned: 0 in 0.904s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9612457-88a7-4b1c-8a55-b03a70c846e3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:39 devstack sudo[114377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9612457-88a7-4b1c-8a55-b03a70c846e3 Jun 25 17:29:39 devstack sudo[114377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:39 devstack sudo[114377]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9612457-88a7-4b1c-8a55-b03a70c846e3" returned: 0 in 0.643s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:29:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.443s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-924764676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40edacbf-9446-4116-b0f6-be68d87294c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a2b647f85c4059b024d208d167f035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:32Z,use_quota=True,user_id='d03b72014103453697c894fc58cf8534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:29:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Creating volume 40edacbf-9446-4116-b0f6-be68d87294c0 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:29:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:29:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:29:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:39 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:29:39 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:29:39 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-40edacbf-9446-4116-b0f6-be68d87294c0 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:39 devstack sudo[114380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-40edacbf-9446-4116-b0f6-be68d87294c0 1073741824 Jun 25 17:29:39 devstack sudo[114380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abcbe08c-760a-4ee7-8513-d9069058636e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9612457-88a7-4b1c-8a55-b03a70c846e3', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ea64c6-9001-4bc8-b6ae-d6a8f511f6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:40 devstack sudo[114380]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-40edacbf-9446-4116-b0f6-be68d87294c0 1073741824" returned: 0 in 0.828s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:42 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Volume volume-d9612457-88a7-4b1c-8a55-b03a70c846e3 (d9612457-88a7-4b1c-8a55-b03a70c846e3): created successfully Jun 25 17:29:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ea64c6-9001-4bc8-b6ae-d6a8f511f6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Flow 'volume_create_manager' (28011340-e647-4af2-a0de-3dac6a6e7014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:29:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:29:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:29:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:44 devstack sudo[114387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:29:44 devstack sudo[114387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:44 devstack sudo[114387]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.630s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:44 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:29:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:29:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 28 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:29:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:29:45 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-6eb27c58-0a49-47ee-b519-a22eb507a9ba tempest-CreateVolumesFromImageTest-1860393279 None] Created volume successfully. Jun 25 17:29:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-40edacbf-9446-4116-b0f6-be68d87294c0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:45 devstack sudo[114390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-40edacbf-9446-4116-b0f6-be68d87294c0 Jun 25 17:29:45 devstack sudo[114390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:45 devstack sudo[114390]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-40edacbf-9446-4116-b0f6-be68d87294c0" returned: 0 in 0.663s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] <== create_volume: return (5963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:29:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.966s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.953s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1712649911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c03cf88a-580e-4a99-8265-0176117f852d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a2b647f85c4059b024d208d167f035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:33Z,use_quota=True,user_id='d03b72014103453697c894fc58cf8534',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:29:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Creating volume c03cf88a-580e-4a99-8265-0176117f852d {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:29:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:29:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:29:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:29:45 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:29:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c03cf88a-580e-4a99-8265-0176117f852d 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d37c70ed-8f9f-4942-b8ef-2548c677fb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40edacbf-9446-4116-b0f6-be68d87294c0', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:45 devstack sudo[114393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c03cf88a-580e-4a99-8265-0176117f852d 1073741824 Jun 25 17:29:45 devstack sudo[114393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b662466-3bb6-4959-98af-746f9866e4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:45 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Volume volume-40edacbf-9446-4116-b0f6-be68d87294c0 (40edacbf-9446-4116-b0f6-be68d87294c0): created successfully Jun 25 17:29:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b662466-3bb6-4959-98af-746f9866e4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Flow 'volume_create_manager' (509c324e-3a99-48dd-9a38-e6ee28f60624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:45 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-781bab62-a565-4fe8-aaff-de646d2e7e13 tempest-CreateVolumesFromImageTest-1860393279 None] Created volume successfully. Jun 25 17:29:46 devstack sudo[114393]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c03cf88a-580e-4a99-8265-0176117f852d 1073741824" returned: 0 in 0.844s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c03cf88a-580e-4a99-8265-0176117f852d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:46 devstack sudo[114399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c03cf88a-580e-4a99-8265-0176117f852d Jun 25 17:29:46 devstack sudo[114399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:47 devstack sudo[114399]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c03cf88a-580e-4a99-8265-0176117f852d" returned: 0 in 0.653s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:29:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-468b1b07-b731-4007-978a-e6d8c862b8ff tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.514s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-468b1b07-b731-4007-978a-e6d8c862b8ff tempest-CreateVolumesFromSnapshotTest-615178772 None] Creating offline snapshot be52cbc3-9bce-4567-b7fe-5f13c96271a0 of volume 725acb90-0861-4e15-855b-08c4505e639c {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:29:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28c763c-a2ab-4b2a-bae5-1fb0e3b33d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c03cf88a-580e-4a99-8265-0176117f852d', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d72e69c-99a8-437a-b943-0a1ded90dc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:47 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e88ce16-9f5e-41f8-aacc-a2b896b52324]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:29:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-468b1b07-b731-4007-978a-e6d8c862b8ff tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:47 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Volume volume-c03cf88a-580e-4a99-8265-0176117f852d (c03cf88a-580e-4a99-8265-0176117f852d): created successfully Jun 25 17:29:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d72e69c-99a8-437a-b943-0a1ded90dc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Flow 'volume_create_manager' (317b8a54-5c84-4b74-b493-16080bdbbd54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:47 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-30c68f55-77ac-48d8-b56b-f2e50842b74b tempest-CreateVolumesFromImageTest-1860393279 None] Created volume successfully. Jun 25 17:29:47 devstack sudo[114402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c Jun 25 17:29:47 devstack sudo[114402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:47 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "cinder-c03cf88a-580e-4a99-8265-0176117f852d-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:29:47 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-c03cf88a-580e-4a99-8265-0176117f852d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:29:47 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "cinder-quobyte-c03cf88a-580e-4a99-8265-0176117f852d" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:29:47 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-quobyte-c03cf88a-580e-4a99-8265-0176117f852d" acquired by "delete_volume" :: waited 0.017s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:29:47 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c5e3a4-9b42-4bbf-9ac4-59d6b0583090]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:29:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c03cf88a-580e-4a99-8265-0176117f852d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:48 devstack sudo[114404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c03cf88a-580e-4a99-8265-0176117f852d Jun 25 17:29:48 devstack sudo[114404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:48 devstack sudo[114402]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-468b1b07-b731-4007-978a-e6d8c862b8ff tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c" returned: 0 in 0.769s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-468b1b07-b731-4007-978a-e6d8c862b8ff tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:48 devstack sudo[114409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0 1G Jun 25 17:29:48 devstack sudo[114409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:48 devstack sudo[114404]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c03cf88a-580e-4a99-8265-0176117f852d" returned: 0 in 0.823s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c03cf88a-580e-4a99-8265-0176117f852d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:48 devstack sudo[114416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c03cf88a-580e-4a99-8265-0176117f852d Jun 25 17:29:48 devstack sudo[114416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:49 devstack sudo[114409]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-468b1b07-b731-4007-978a-e6d8c862b8ff tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0 1G" returned: 0 in 0.844s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-468b1b07-b731-4007-978a-e6d8c862b8ff tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-725acb90-0861-4e15-855b-08c4505e639c -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:49 devstack sudo[114419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-725acb90-0861-4e15-855b-08c4505e639c -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0 Jun 25 17:29:49 devstack sudo[114419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:49 devstack sudo[114416]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-c03cf88a-580e-4a99-8265-0176117f852d" returned: 0 in 0.661s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:49 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-quobyte-c03cf88a-580e-4a99-8265-0176117f852d" released by "delete_volume" :: held 1.529s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:29:49 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] Created reservations ['f3502776-9218-42cd-bf64-b3ec46913bc5', '115a1a11-591f-4864-8649-7c74d1ad0c2e', '4602d4a1-eb3a-4ba5-9679-9eea4aaa465d', 'b3e6b1fe-c13f-43b0-9f2c-65183e0aec8b'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:29:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:49 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:29:49 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:29:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:49 devstack sudo[114424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:29:49 devstack sudo[114424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:49 devstack sudo[114419]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-468b1b07-b731-4007-978a-e6d8c862b8ff tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-725acb90-0861-4e15-855b-08c4505e639c -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0" returned: 0 in 0.712s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:49 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-468b1b07-b731-4007-978a-e6d8c862b8ff tempest-CreateVolumesFromSnapshotTest-615178772 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0 is being set with open permissions: ugo+rw Jun 25 17:29:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-468b1b07-b731-4007-978a-e6d8c862b8ff tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:49 devstack sudo[114427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0 Jun 25 17:29:49 devstack sudo[114427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "cinder-40edacbf-9446-4116-b0f6-be68d87294c0-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:29:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-40edacbf-9446-4116-b0f6-be68d87294c0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:29:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "cinder-quobyte-40edacbf-9446-4116-b0f6-be68d87294c0" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:29:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-quobyte-40edacbf-9446-4116-b0f6-be68d87294c0" acquired by "delete_volume" :: waited 0.017s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:29:50 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e74ce0c-8870-4b71-8a50-8c2037e2213e]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:29:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-40edacbf-9446-4116-b0f6-be68d87294c0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:50 devstack sudo[114424]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.733s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:50 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:29:50 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] Deleted volume successfully. Jun 25 17:29:50 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-1ec24c3b-631a-4b45-9e3b-b60763879298 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-c03cf88a-580e-4a99-8265-0176117f852d-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:29:50 devstack sudo[114430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-40edacbf-9446-4116-b0f6-be68d87294c0 Jun 25 17:29:50 devstack sudo[114430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:50 devstack sudo[114427]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-468b1b07-b731-4007-978a-e6d8c862b8ff tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0" returned: 0 in 0.666s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-468b1b07-b731-4007-978a-e6d8c862b8ff tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:50 devstack sudo[114433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.info Jun 25 17:29:50 devstack sudo[114433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:51 devstack sudo[114430]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-40edacbf-9446-4116-b0f6-be68d87294c0" returned: 0 in 0.809s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-40edacbf-9446-4116-b0f6-be68d87294c0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:51 devstack sudo[114440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-40edacbf-9446-4116-b0f6-be68d87294c0 Jun 25 17:29:51 devstack sudo[114440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:51 devstack sudo[114433]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-468b1b07-b731-4007-978a-e6d8c862b8ff tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.info" returned: 0 in 0.665s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:51 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-468b1b07-b731-4007-978a-e6d8c862b8ff tempest-CreateVolumesFromSnapshotTest-615178772 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.info is being set with open permissions: ugo+rw Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-468b1b07-b731-4007-978a-e6d8c862b8ff tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:51 devstack sudo[114442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.info Jun 25 17:29:51 devstack sudo[114442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:51 devstack sudo[114440]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-40edacbf-9446-4116-b0f6-be68d87294c0" returned: 0 in 0.641s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-quobyte-40edacbf-9446-4116-b0f6-be68d87294c0" released by "delete_volume" :: held 1.513s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] Created reservations ['15dc089d-992a-464f-a599-806e1c82f183', 'ac0c3261-7acd-4deb-95c8-5207c595050e', '1a7b264d-12c4-423a-aa01-469a03864d92', 'cc221a6d-b05c-4af6-bf04-98e162d9ddcf'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:29:51 devstack sudo[114442]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-468b1b07-b731-4007-978a-e6d8c862b8ff tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.info" returned: 0 in 0.679s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-468b1b07-b731-4007-978a-e6d8c862b8ff tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.434s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.242s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e594d18132a946bebca6e7f7687bceda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:35Z,use_quota=True,user_id='ef423441f715452bb3b7cbe9ca8c97b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d458cf8d-3e40-4a0c-bf0e-5f80fd1041ea),volume_type_id=d458cf8d-3e40-4a0c-bf0e-5f80fd1041ea)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Creating volume 2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:29:51 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:51 devstack sudo[114446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 1073741824 Jun 25 17:29:51 devstack sudo[114446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:51 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-468b1b07-b731-4007-978a-e6d8c862b8ff tempest-CreateVolumesFromSnapshotTest-615178772 None] Create snapshot completed successfully Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:51 devstack sudo[114448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:29:51 devstack sudo[114448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "cinder-d9612457-88a7-4b1c-8a55-b03a70c846e3-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:29:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-d9612457-88a7-4b1c-8a55-b03a70c846e3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:29:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "cinder-quobyte-d9612457-88a7-4b1c-8a55-b03a70c846e3" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:29:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-quobyte-d9612457-88a7-4b1c-8a55-b03a70c846e3" acquired by "delete_volume" :: waited 0.028s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:29:52 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaaec92-48c9-4c91-9780-14b875d3dad9]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:29:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9612457-88a7-4b1c-8a55-b03a70c846e3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:52 devstack sudo[114453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9612457-88a7-4b1c-8a55-b03a70c846e3 Jun 25 17:29:52 devstack sudo[114453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:52 devstack sudo[114448]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.769s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:52 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:29:52 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] Deleted volume successfully. Jun 25 17:29:52 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-efbf11fc-1a6c-4bec-ac2c-4cec9d8b8c3d tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-40edacbf-9446-4116-b0f6-be68d87294c0-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:29:52 devstack sudo[114446]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 1073741824" returned: 0 in 0.952s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:52 devstack sudo[114457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 Jun 25 17:29:52 devstack sudo[114457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Flow 'volume_create_manager' (1f2aae74-afe0-4bcb-8c6e-dffc2861f70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e43c9ba-365d-4136-ad90-ddf8522b7b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e43c9ba-365d-4136-ad90-ddf8522b7b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-614791125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5236bf79-8928-41cf-b1a3-86dc6af12cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3b0db03227495c9ffd2eb6d8aa1f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:53Z,use_quota=True,user_id='933cba04e0f540acaf5aba81ce64a03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4530245-41c9-489a-b131-6d25b42eb947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4530245-41c9-489a-b131-6d25b42eb947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c306cc-6887-4fd4-b0d9-5914d0ab4975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c306cc-6887-4fd4-b0d9-5914d0ab4975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5236bf79-8928-41cf-b1a3-86dc6af12cb8', 'volume_name': 'volume-5236bf79-8928-41cf-b1a3-86dc6af12cb8', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f27533-bb05-4b98-a1c2-3ab759442225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f27533-bb05-4b98-a1c2-3ab759442225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d102d011-ea1a-4054-b757-b936f6558a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:53 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Volume 5236bf79-8928-41cf-b1a3-86dc6af12cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5236bf79-8928-41cf-b1a3-86dc6af12cb8', 'volume_size': 1} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:53 devstack sudo[114453]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9612457-88a7-4b1c-8a55-b03a70c846e3" returned: 0 in 0.899s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9612457-88a7-4b1c-8a55-b03a70c846e3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:53 devstack sudo[114462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9612457-88a7-4b1c-8a55-b03a70c846e3 Jun 25 17:29:53 devstack sudo[114462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Flow 'volume_create_manager' (45e0f732-df90-4581-9463-f0d0b9d06a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4d2646-6b4a-4647-af18-79a3dfea4f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4d2646-6b4a-4647-af18-79a3dfea4f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-239343780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4665c7b9-987a-4848-a9a8-c751e463aa99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3b0db03227495c9ffd2eb6d8aa1f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:53Z,use_quota=True,user_id='933cba04e0f540acaf5aba81ce64a03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b561485-e09d-4b39-a1f7-6ec574c112ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b561485-e09d-4b39-a1f7-6ec574c112ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:53 devstack sudo[114457]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeba2ee6-95e5-423a-a504-919dfa3e3809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeba2ee6-95e5-423a-a504-919dfa3e3809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4665c7b9-987a-4848-a9a8-c751e463aa99', 'volume_name': 'volume-4665c7b9-987a-4848-a9a8-c751e463aa99', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d282734b-3155-4970-9664-8922a3946e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d282734b-3155-4970-9664-8922a3946e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e882e4b0-c281-4a09-99dd-afcab1faf3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:53 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Volume 4665c7b9-987a-4848-a9a8-c751e463aa99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4665c7b9-987a-4848-a9a8-c751e463aa99', 'volume_size': 1} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4" returned: 0 in 0.905s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5512a2e8-d684-49a9-b3d6-ce360f766085 tempest-VolumeDependencyTests-1907395917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.887s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-5512a2e8-d684-49a9-b3d6-ce360f766085 tempest-VolumeDependencyTests-1907395917 None] Creating offline snapshot 67715d92-32c6-4f49-8f2f-6018c8a46038 of volume e88ca21b-011f-4ba2-afc1-f5db5088c9b9 {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Attempting download of d409c8d1-da57-4c0c-85cd-f3c403412ddb ((None, [{'url': 'file:///opt/stack/data/glance/images/d409c8d1-da57-4c0c-85cd-f3c403412ddb', 'metadata': {}}])) to volume 2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4. {{(pid=93869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee85cb79-fa71-4285-82f6-642f1a417868]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5512a2e8-d684-49a9-b3d6-ce360f766085 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bc9945-33dd-417f-89ad-6acd76c1dab3]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:29:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d409c8d1-da57-4c0c-85cd-f3c403412ddb_s1gp0_1y {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:53 devstack sudo[114465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 Jun 25 17:29:53 devstack sudo[114465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:29:54 devstack sudo[114467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d409c8d1-da57-4c0c-85cd-f3c403412ddb_s1gp0_1y Jun 25 17:29:54 devstack sudo[114467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Flow 'volume_create_manager' (fab502d2-a74f-4b2c-bd81-52b4f5eab71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e52d490-63d1-417b-ae7d-7845a6d552bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e52d490-63d1-417b-ae7d-7845a6d552bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1187768605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a3497f-0169-4958-8238-0bcf1e9725d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3b0db03227495c9ffd2eb6d8aa1f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:54Z,use_quota=True,user_id='933cba04e0f540acaf5aba81ce64a03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8105a2-768b-41ee-9e60-060e8f84f3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8105a2-768b-41ee-9e60-060e8f84f3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f1b759-e49c-4320-a392-fc1f4a85a460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9f1b759-e49c-4320-a392-fc1f4a85a460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5a3497f-0169-4958-8238-0bcf1e9725d3', 'volume_name': 'volume-f5a3497f-0169-4958-8238-0bcf1e9725d3', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62be218-6ff0-4e7e-9803-04830a689678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e62be218-6ff0-4e7e-9803-04830a689678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa91d2c6-af84-40db-bf6f-f0e7b2859077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:54 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Volume f5a3497f-0169-4958-8238-0bcf1e9725d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5a3497f-0169-4958-8238-0bcf1e9725d3', 'volume_size': 1} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:54 devstack sudo[114462]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-d9612457-88a7-4b1c-8a55-b03a70c846e3" returned: 0 in 0.992s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-quobyte-d9612457-88a7-4b1c-8a55-b03a70c846e3" released by "delete_volume" :: held 1.944s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] Created reservations ['8178b2c0-b0e9-4b0a-b3bc-98ed19ac0538', '38c49516-007c-4935-bfc9-eca8b19854c2', '8af61e49-2d2c-4a11-b4ad-d484a884ec02', 'b3b0bece-2250-4d53-95c5-5e326ef8ddb3'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Flow 'volume_create_manager' (29f8e0bf-21f5-4fa6-9320-c7e943b9393c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d9b20c8-2050-47bc-88cc-670e64374bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d9b20c8-2050-47bc-88cc-670e64374bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1122192594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ca579c-e05d-489a-b418-fc1c9b2704b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3b0db03227495c9ffd2eb6d8aa1f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:55Z,use_quota=True,user_id='933cba04e0f540acaf5aba81ce64a03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75b8729-da6d-4dce-b4f3-8702547a06de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e75b8729-da6d-4dce-b4f3-8702547a06de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:54 devstack sudo[114472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:29:54 devstack sudo[114472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de45dd65-3989-469a-a016-a86b37528a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de45dd65-3989-469a-a016-a86b37528a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32ca579c-e05d-489a-b418-fc1c9b2704b8', 'volume_name': 'volume-32ca579c-e05d-489a-b418-fc1c9b2704b8', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e1fd24-c6da-4373-bc52-6d738ff9eff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e1fd24-c6da-4373-bc52-6d738ff9eff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (022e852c-5e72-417d-9b97-10135aee23ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:54 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Volume 32ca579c-e05d-489a-b418-fc1c9b2704b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32ca579c-e05d-489a-b418-fc1c9b2704b8', 'volume_size': 1} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "cinder-08e27930-56cf-43e8-bb2e-5b77b7aa7309-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-08e27930-56cf-43e8-bb2e-5b77b7aa7309-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:29:54 devstack sudo[114467]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d409c8d1-da57-4c0c-85cd-f3c403412ddb_s1gp0_1y" returned: 0 in 1.008s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d409c8d1-da57-4c0c-85cd-f3c403412ddb_s1gp0_1y {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "cinder-quobyte-08e27930-56cf-43e8-bb2e-5b77b7aa7309" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:29:54 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-quobyte-08e27930-56cf-43e8-bb2e-5b77b7aa7309" acquired by "delete_volume" :: waited 0.026s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[588601e6-8bb2-4a0d-a816-3319f56e867d]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-08e27930-56cf-43e8-bb2e-5b77b7aa7309 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:55 devstack sudo[114465]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:55 devstack sudo[114478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d409c8d1-da57-4c0c-85cd-f3c403412ddb_s1gp0_1y Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5512a2e8-d684-49a9-b3d6-ce360f766085 tempest-VolumeDependencyTests-1907395917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9" returned: 0 in 1.263s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:55 devstack sudo[114478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5512a2e8-d684-49a9-b3d6-ce360f766085 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:55 devstack sudo[114481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038 1G Jun 25 17:29:55 devstack sudo[114481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:55 devstack sudo[114479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-08e27930-56cf-43e8-bb2e-5b77b7aa7309 Jun 25 17:29:55 devstack sudo[114479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Flow 'volume_create_manager' (7a606e7e-733c-4a5b-b38b-b220840da7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32353f3c-e9d8-469f-b09f-868c5930f1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32353f3c-e9d8-469f-b09f-868c5930f1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-129521705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9172c32d-4a54-439e-8cbc-f00627de6181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3b0db03227495c9ffd2eb6d8aa1f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:55Z,use_quota=True,user_id='933cba04e0f540acaf5aba81ce64a03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df2f1cf-fd87-4c1a-bd16-c0731b39729b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df2f1cf-fd87-4c1a-bd16-c0731b39729b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aca1609-1b87-4ba3-8ab0-f222101b8290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aca1609-1b87-4ba3-8ab0-f222101b8290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9172c32d-4a54-439e-8cbc-f00627de6181', 'volume_name': 'volume-9172c32d-4a54-439e-8cbc-f00627de6181', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dc1798-12d7-413a-ad66-86ba4b22b8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7dc1798-12d7-413a-ad66-86ba4b22b8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a774f7bd-2e06-49da-9d2b-e3c819dd033b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:29:55 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Volume 9172c32d-4a54-439e-8cbc-f00627de6181: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9172c32d-4a54-439e-8cbc-f00627de6181', 'volume_size': 1} Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:55 devstack sudo[114472]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.990s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:29:55 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] Deleted volume successfully. Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6d06e5a7-8e85-448a-99f9-84e36d119068 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-d9612457-88a7-4b1c-8a55-b03a70c846e3-delete_volume" released by "delete_volume" :: held 3.326s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:29:55 devstack sudo[114478]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d409c8d1-da57-4c0c-85cd-f3c403412ddb_s1gp0_1y" returned: 1 in 1.038s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d409c8d1-da57-4c0c-85cd-f3c403412ddb_s1gp0_1y' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f137f23d-37e5-46ca-bc7f-1bcb5c9e9e3c]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:29:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:56 devstack sudo[114490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD Jun 25 17:29:56 devstack sudo[114490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:56 devstack sudo[114481]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5512a2e8-d684-49a9-b3d6-ce360f766085 tempest-VolumeDependencyTests-1907395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038 1G" returned: 0 in 0.996s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5512a2e8-d684-49a9-b3d6-ce360f766085 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:56 devstack sudo[114479]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-08e27930-56cf-43e8-bb2e-5b77b7aa7309" returned: 0 in 1.046s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-08e27930-56cf-43e8-bb2e-5b77b7aa7309 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:56 devstack sudo[114495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038 Jun 25 17:29:56 devstack sudo[114495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:56 devstack sudo[114496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-08e27930-56cf-43e8-bb2e-5b77b7aa7309 Jun 25 17:29:56 devstack sudo[114496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:56 devstack sudo[114490]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD" returned: 0 in 0.823s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:56 devstack sudo[114496]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-08e27930-56cf-43e8-bb2e-5b77b7aa7309" returned: 0 in 0.675s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:56 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-quobyte-08e27930-56cf-43e8-bb2e-5b77b7aa7309" released by "delete_volume" :: held 1.820s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:29:56 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] Created reservations ['f46cb612-fbd5-4068-b100-156663e44462', '741f13a2-0890-471b-b3da-c386937b8bfa', 'dc2aa448-2c4d-4abe-b02a-c5682f82dc85', '633298cb-a579-4d36-b835-de6186654eec'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:29:56 devstack sudo[114505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD Jun 25 17:29:56 devstack sudo[114505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:29:56 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:29:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:56 devstack sudo[114495]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5512a2e8-d684-49a9-b3d6-ce360f766085 tempest-VolumeDependencyTests-1907395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038" returned: 0 in 0.880s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:56 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-5512a2e8-d684-49a9-b3d6-ce360f766085 tempest-VolumeDependencyTests-1907395917 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038 is being set with open permissions: ugo+rw Jun 25 17:29:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5512a2e8-d684-49a9-b3d6-ce360f766085 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:56 devstack sudo[114508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:29:56 devstack sudo[114508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:56 devstack sudo[114509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038 Jun 25 17:29:56 devstack sudo[114509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "cinder-32e9466e-8d6f-45ca-befb-cb17e246c68b-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:29:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-32e9466e-8d6f-45ca-befb-cb17e246c68b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:29:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "cinder-quobyte-32e9466e-8d6f-45ca-befb-cb17e246c68b" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:29:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-quobyte-32e9466e-8d6f-45ca-befb-cb17e246c68b" acquired by "delete_volume" :: waited 0.021s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:29:57 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[336f89f3-6972-483b-869e-ca1339503a52]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:29:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32e9466e-8d6f-45ca-befb-cb17e246c68b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:57 devstack sudo[114512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32e9466e-8d6f-45ca-befb-cb17e246c68b Jun 25 17:29:57 devstack sudo[114512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:57 devstack sudo[114509]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5512a2e8-d684-49a9-b3d6-ce360f766085 tempest-VolumeDependencyTests-1907395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038" returned: 0 in 0.848s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5512a2e8-d684-49a9-b3d6-ce360f766085 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:57 devstack sudo[114505]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD" returned: 1 in 1.107s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:29:57 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] d409c8d1-da57-4c0c-85cd-f3c403412ddb was raw, converting to raw {{(pid=93869) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 17:29:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:57 devstack sudo[114519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.info Jun 25 17:29:57 devstack sudo[114519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:57 devstack sudo[114508]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:57 devstack sudo[114521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 Jun 25 17:29:57 devstack sudo[114521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.965s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:57 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:29:57 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] Deleted volume successfully. Jun 25 17:29:57 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8293b7bb-7094-4b23-b86c-97b59b85c0d9 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-08e27930-56cf-43e8-bb2e-5b77b7aa7309-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:29:58 devstack sudo[114512]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32e9466e-8d6f-45ca-befb-cb17e246c68b" returned: 0 in 0.951s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32e9466e-8d6f-45ca-befb-cb17e246c68b {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:58 devstack sudo[114526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32e9466e-8d6f-45ca-befb-cb17e246c68b Jun 25 17:29:58 devstack sudo[114526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:58 devstack sudo[114519]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5512a2e8-d684-49a9-b3d6-ce360f766085 tempest-VolumeDependencyTests-1907395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.info" returned: 0 in 0.699s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:58 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-5512a2e8-d684-49a9-b3d6-ce360f766085 tempest-VolumeDependencyTests-1907395917 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.info is being set with open permissions: ugo+rw Jun 25 17:29:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5512a2e8-d684-49a9-b3d6-ce360f766085 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:58 devstack sudo[114531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.info Jun 25 17:29:58 devstack sudo[114531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:58 devstack sudo[114521]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4" returned: 0 in 0.966s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:58 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d409c8d1-da57-4c0c-85cd-f3c403412ddb_ti7qpaxxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:29:58 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Converted 0.00 MB image at 0.00 MB/s Jun 25 17:29:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:58 devstack sudo[114535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 1G Jun 25 17:29:58 devstack sudo[114535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:58 devstack sudo[114526]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32e9466e-8d6f-45ca-befb-cb17e246c68b" returned: 0 in 0.732s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-quobyte-32e9466e-8d6f-45ca-befb-cb17e246c68b" released by "delete_volume" :: held 1.755s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:29:58 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] Created reservations ['55d944cc-c25f-4834-9caf-be530ff120b2', '88778ca9-0403-4fea-8727-572bfa859293', '980321bf-3b1e-4dd1-9e76-8380079090ce', '2922321b-506e-4003-bc46-931766cf7179'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:59 devstack sudo[114537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:29:59 devstack sudo[114537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:59 devstack sudo[114531]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5512a2e8-d684-49a9-b3d6-ce360f766085 tempest-VolumeDependencyTests-1907395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.info" returned: 0 in 0.791s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5512a2e8-d684-49a9-b3d6-ce360f766085 tempest-VolumeDependencyTests-1907395917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.623s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.173s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-614791125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5236bf79-8928-41cf-b1a3-86dc6af12cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3b0db03227495c9ffd2eb6d8aa1f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:53Z,use_quota=True,user_id='933cba04e0f540acaf5aba81ce64a03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Creating volume 5236bf79-8928-41cf-b1a3-86dc6af12cb8 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:29:59 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5236bf79-8928-41cf-b1a3-86dc6af12cb8 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:59 devstack sudo[114546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5236bf79-8928-41cf-b1a3-86dc6af12cb8 1073741824 Jun 25 17:29:59 devstack sudo[114546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:29:59 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-5512a2e8-d684-49a9-b3d6-ce360f766085 tempest-VolumeDependencyTests-1907395917 None] Create snapshot completed successfully Jun 25 17:29:59 devstack sudo[114535]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 1G" returned: 0 in 1.094s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d455add0-a3e7-4d90-965c-5ce232f217e0]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:29:59 devstack sudo[114537]: pam_unix(sudo:session): session closed for user root Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.967s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:29:59 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:30:00 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] Deleted volume successfully. Jun 25 17:30:00 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-42ea4a74-e165-43b1-9c0d-ada8ec4e6b54 tempest-CreateVolumesFromImageTest-1860393279 None] Lock "cinder-32e9466e-8d6f-45ca-befb-cb17e246c68b-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:00 devstack sudo[114552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 Jun 25 17:30:00 devstack sudo[114552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:00 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:30:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Flow 'volume_create_manager' (9bcc7918-5cb0-4edf-9dd4-88685e573e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49951a94-f8f8-4d5c-89e3-874b9c2a58bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49951a94-f8f8-4d5c-89e3-874b9c2a58bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-395101075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d3c5173-0f09-4484-91db-b70e0fd08cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e368e00893514fd3a8510dd9ca3c1c3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=67715d92-32c6-4f49-8f2f-6018c8a46038,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:00Z,use_quota=True,user_id='7d7e8cd747e142dda1287279e4c6fb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce146960-ad67-4e23-b698-a1797980f16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce146960-ad67-4e23-b698-a1797980f16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e523a9b8-525e-408f-a00e-08a5b2ec95c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e523a9b8-525e-408f-a00e-08a5b2ec95c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1d3c5173-0f09-4484-91db-b70e0fd08cfd', 'volume_name': 'volume-1d3c5173-0f09-4484-91db-b70e0fd08cfd', 'volume_size': 1, 'snapshot_id': '67715d92-32c6-4f49-8f2f-6018c8a46038'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66bcc53-351b-4cda-93a4-8745a3fbf5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66bcc53-351b-4cda-93a4-8745a3fbf5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:00 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22b8c0f-70bb-4fd5-90fd-316b8cc5c3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:00 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Volume 1d3c5173-0f09-4484-91db-b70e0fd08cfd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1d3c5173-0f09-4484-91db-b70e0fd08cfd', 'volume_size': 1, 'snapshot_id': '67715d92-32c6-4f49-8f2f-6018c8a46038'} Jun 25 17:30:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:00 devstack sudo[114546]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5236bf79-8928-41cf-b1a3-86dc6af12cb8 1073741824" returned: 0 in 1.322s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5236bf79-8928-41cf-b1a3-86dc6af12cb8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:00 devstack sudo[114558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5236bf79-8928-41cf-b1a3-86dc6af12cb8 Jun 25 17:30:00 devstack sudo[114558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:01 devstack sudo[114552]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4" returned: 0 in 1.049s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:01 devstack sudo[114563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 Jun 25 17:30:01 devstack sudo[114563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:01 devstack sudo[114558]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5236bf79-8928-41cf-b1a3-86dc6af12cb8" returned: 0 in 0.728s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] <== create_volume: return (2100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:30:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.108s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.761s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-239343780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4665c7b9-987a-4848-a9a8-c751e463aa99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3b0db03227495c9ffd2eb6d8aa1f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:53Z,use_quota=True,user_id='933cba04e0f540acaf5aba81ce64a03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:30:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Creating volume 4665c7b9-987a-4848-a9a8-c751e463aa99 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:30:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:01 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:30:01 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:30:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4665c7b9-987a-4848-a9a8-c751e463aa99 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:01 devstack sudo[114566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4665c7b9-987a-4848-a9a8-c751e463aa99 1073741824 Jun 25 17:30:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d102d011-ea1a-4054-b757-b936f6558a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5236bf79-8928-41cf-b1a3-86dc6af12cb8', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:01 devstack sudo[114566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f72ef12-f2e1-4ee8-85fa-683359c6664c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:01 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Volume volume-5236bf79-8928-41cf-b1a3-86dc6af12cb8 (5236bf79-8928-41cf-b1a3-86dc6af12cb8): created successfully Jun 25 17:30:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f72ef12-f2e1-4ee8-85fa-683359c6664c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:01 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Flow 'volume_create_manager' (1f2aae74-afe0-4bcb-8c6e-dffc2861f70e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:01 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-7c7de2cc-39e7-4f42-9e45-37d6d9f53e28 tempest-CreateVolumesFromSnapshotTest-615178772 None] Created volume successfully. Jun 25 17:30:02 devstack sudo[114563]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4" returned: 1 in 0.995s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:30:02 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Downloaded image d409c8d1-da57-4c0c-85cd-f3c403412ddb ((None, [{'url': 'file:///opt/stack/data/glance/images/d409c8d1-da57-4c0c-85cd-f3c403412ddb', 'metadata': {}}])) to volume 2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 successfully. {{(pid=93869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 17:30:02 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Temporary image d409c8d1-da57-4c0c-85cd-f3c403412ddb for user ef423441f715452bb3b7cbe9ca8c97b5 is deleted. {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 17:30:02 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Marking volume 2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 as bootable. {{(pid=93869) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 17:30:02 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Copying metadata from image d409c8d1-da57-4c0c-85cd-f3c403412ddb to 2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4. {{(pid=93869) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 17:30:02 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Creating volume glance metadata for volume 2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 backed by image d409c8d1-da57-4c0c-85cd-f3c403412ddb with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'd409c8d1-da57-4c0c-85cd-f3c403412ddb', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '9c5b5c3fc53726f1f12842e16095b426', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93869) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 17:30:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89192d69-02a6-4d85-bd12-5118e054df41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4', 'volume_size': 1, 'image_id': 'd409c8d1-da57-4c0c-85cd-f3c403412ddb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d409c8d1-da57-4c0c-85cd-f3c403412ddb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9c5b5c3fc53726f1f12842e16095b426', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e594d18132a946bebca6e7f7687bceda', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd61b1132e3933d0d31aaf640e967a16544505a16ecc3d26d921318e449facb7c5a21c7d4229d12c561a6024086abc25a10916afd5055928e36ad051020ecb3fa', 'id': 'd409c8d1-da57-4c0c-85cd-f3c403412ddb', 'created_at': datetime.datetime(2026, 6, 25, 15, 29, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d409c8d1-da57-4c0c-85cd-f3c403412ddb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4628159-a832-4265-a453-785e8270b082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:02 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Volume volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 (2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4): created successfully Jun 25 17:30:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4628159-a832-4265-a453-785e8270b082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:02 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Flow 'volume_create_manager' (c266383e-223e-49ca-98e0-01b73984d9f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:02 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-c99f3477-1a5f-4234-9639-1b01482c8abf tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Created volume successfully. Jun 25 17:30:02 devstack sudo[114566]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4665c7b9-987a-4848-a9a8-c751e463aa99 1073741824" returned: 0 in 0.990s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4665c7b9-987a-4848-a9a8-c751e463aa99 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:02 devstack sudo[114575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4665c7b9-987a-4848-a9a8-c751e463aa99 Jun 25 17:30:02 devstack sudo[114575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Acquiring lock "cinder-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Lock "cinder-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Acquiring lock "cinder-quobyte-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Lock "cinder-quobyte-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4" acquired by "delete_volume" :: waited 0.021s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84f6dbd-361c-456d-ae70-879ddd041767]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:03 devstack sudo[114577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 Jun 25 17:30:03 devstack sudo[114577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:03 devstack sudo[114575]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4665c7b9-987a-4848-a9a8-c751e463aa99" returned: 0 in 0.758s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.156s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1187768605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5a3497f-0169-4958-8238-0bcf1e9725d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3b0db03227495c9ffd2eb6d8aa1f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:54Z,use_quota=True,user_id='933cba04e0f540acaf5aba81ce64a03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Creating volume f5a3497f-0169-4958-8238-0bcf1e9725d3 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:30:03 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f5a3497f-0169-4958-8238-0bcf1e9725d3 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:03 devstack sudo[114580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f5a3497f-0169-4958-8238-0bcf1e9725d3 1073741824 Jun 25 17:30:03 devstack sudo[114580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e882e4b0-c281-4a09-99dd-afcab1faf3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4665c7b9-987a-4848-a9a8-c751e463aa99', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e0fb07-cab1-4cf7-96f8-093c93ddf9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:03 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Volume volume-4665c7b9-987a-4848-a9a8-c751e463aa99 (4665c7b9-987a-4848-a9a8-c751e463aa99): created successfully Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7e0fb07-cab1-4cf7-96f8-093c93ddf9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Flow 'volume_create_manager' (45e0f732-df90-4581-9463-f0d0b9d06a86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:03 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-a742630a-00d6-4df8-8c74-8d5c083e1d36 tempest-CreateVolumesFromSnapshotTest-615178772 None] Created volume successfully. Jun 25 17:30:03 devstack sudo[114577]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4" returned: 0 in 0.861s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:04 devstack sudo[114585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 Jun 25 17:30:04 devstack sudo[114585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:04 devstack sudo[114580]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f5a3497f-0169-4958-8238-0bcf1e9725d3 1073741824" returned: 0 in 1.107s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f5a3497f-0169-4958-8238-0bcf1e9725d3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:04 devstack sudo[114592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f5a3497f-0169-4958-8238-0bcf1e9725d3 Jun 25 17:30:04 devstack sudo[114592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:04 devstack sudo[114585]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4" returned: 1 in 0.968s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:30:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:04 devstack sudo[114597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4 Jun 25 17:30:04 devstack sudo[114597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:05 devstack sudo[114592]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f5a3497f-0169-4958-8238-0bcf1e9725d3" returned: 0 in 0.832s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] <== create_volume: return (1999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.514s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1122192594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ca579c-e05d-489a-b418-fc1c9b2704b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3b0db03227495c9ffd2eb6d8aa1f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:55Z,use_quota=True,user_id='933cba04e0f540acaf5aba81ce64a03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Creating volume 32ca579c-e05d-489a-b418-fc1c9b2704b8 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:30:05 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32ca579c-e05d-489a-b418-fc1c9b2704b8 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa91d2c6-af84-40db-bf6f-f0e7b2859077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5a3497f-0169-4958-8238-0bcf1e9725d3', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:05 devstack sudo[114600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32ca579c-e05d-489a-b418-fc1c9b2704b8 1073741824 Jun 25 17:30:05 devstack sudo[114600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df06a616-c1b8-4350-88ca-bb6b27a02a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:05 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Volume volume-f5a3497f-0169-4958-8238-0bcf1e9725d3 (f5a3497f-0169-4958-8238-0bcf1e9725d3): created successfully Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df06a616-c1b8-4350-88ca-bb6b27a02a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Flow 'volume_create_manager' (fab502d2-a74f-4b2c-bd81-52b4f5eab71b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:05 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-ce8a7cee-6d5f-4681-9667-72ea3ec6d71e tempest-CreateVolumesFromSnapshotTest-615178772 None] Created volume successfully. Jun 25 17:30:05 devstack sudo[114597]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4" returned: 0 in 0.784s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Lock "cinder-quobyte-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4" released by "delete_volume" :: held 2.699s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Created reservations ['5118d69e-6244-4a90-b1e9-bfa9ea54595a', 'f5cbd143-4b29-4a7b-ad48-35fee35afe67', '3c6c8a67-5b9a-4d3c-badf-5ffc062f1517', '67b3e1c3-949d-443f-abbe-77ce5648a89d'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:05 devstack sudo[114603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:30:05 devstack sudo[114603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:06 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:30:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Flow 'volume_create_manager' (1c43855a-5cb7-4e79-ad97-f64bbefa0dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325e8f04-99d8-4856-9fd8-0244e0a91457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:06 devstack sudo[114600]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32ca579c-e05d-489a-b418-fc1c9b2704b8 1073741824" returned: 0 in 1.211s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325e8f04-99d8-4856-9fd8-0244e0a91457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a824573-4743-4397-bfe1-f78fc4851454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcc1b6140074b7fbd27f1b47cf168e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:06Z,use_quota=True,user_id='67a738037dde4c67bf6d9a942a8f36b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3410cd-079c-4d3c-a15d-538bf8b5ea52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb3410cd-079c-4d3c-a15d-538bf8b5ea52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68875a8c-3ca3-48df-9002-44011639779a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:06 devstack cinder-volume[93869]: DEBUG cinder.image.glance [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Creating Keystone auth plugin from conf {{(pid=93869) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 25 17:30:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32ca579c-e05d-489a-b418-fc1c9b2704b8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:06 devstack sudo[114611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32ca579c-e05d-489a-b418-fc1c9b2704b8 Jun 25 17:30:06 devstack sudo[114611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:06 devstack sudo[114603]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.837s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:06 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:30:06 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Deleted volume successfully. Jun 25 17:30:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b359a34c-6f7e-49fc-8d0e-2228933facb8 tempest-VolumeAndVolumeTypeFromImageTest-449280997 None] Lock "cinder-2c7db14d-1ecd-4c1e-8304-b946c3ff0ba4-delete_volume" released by "delete_volume" :: held 3.852s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68875a8c-3ca3-48df-9002-44011639779a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0a824573-4743-4397-bfe1-f78fc4851454', 'volume_name': 'volume-0a824573-4743-4397-bfe1-f78fc4851454', 'volume_size': 1, 'image_id': '6885732e-2a8f-4410-b2f2-3ce4fe737e01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6885732e-2a8f-4410-b2f2-3ce4fe737e01', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff2296ba464aed2ccfabcb34013a115b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bfcc1b6140074b7fbd27f1b47cf168e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '822296a5d905b0128b2afb941157f49b337d3fe5218877dce7b0793fd8e49f97cffd91c59d92400af61f036fa8fef1097eddd51476dab6134325542cbbc9ae74', 'id': '6885732e-2a8f-4410-b2f2-3ce4fe737e01', 'created_at': datetime.datetime(2026, 6, 25, 15, 30, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 30, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6885732e-2a8f-4410-b2f2-3ce4fe737e01/file', 'properties': {}}, 'image_service': }' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c3a559-b90a-4f92-aaf9-f59ce57f3071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c3a559-b90a-4f92-aaf9-f59ce57f3071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7280eed3-4560-42c2-96dd-2f1ebeb969ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:06 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Volume 0a824573-4743-4397-bfe1-f78fc4851454: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0a824573-4743-4397-bfe1-f78fc4851454', 'volume_size': 1, 'image_id': '6885732e-2a8f-4410-b2f2-3ce4fe737e01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6885732e-2a8f-4410-b2f2-3ce4fe737e01', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff2296ba464aed2ccfabcb34013a115b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bfcc1b6140074b7fbd27f1b47cf168e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '822296a5d905b0128b2afb941157f49b337d3fe5218877dce7b0793fd8e49f97cffd91c59d92400af61f036fa8fef1097eddd51476dab6134325542cbbc9ae74', 'id': '6885732e-2a8f-4410-b2f2-3ce4fe737e01', 'created_at': datetime.datetime(2026, 6, 25, 15, 30, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 30, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6885732e-2a8f-4410-b2f2-3ce4fe737e01/file', 'properties': {}}, 'image_service': } Jun 25 17:30:06 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Trying to clone 0a824573-4743-4397-bfe1-f78fc4851454 from image 6885732e-2a8f-4410-b2f2-3ce4fe737e01 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6885732e-2a8f-4410-b2f2-3ce4fe737e01', 'metadata': {}}]). {{(pid=93869) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 25 17:30:07 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Image download 0.00 MB at 0.00 MB/s Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[caeddf8e-2672-4947-8f59-9245c2fb4453]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:07 devstack sudo[114613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD Jun 25 17:30:07 devstack sudo[114613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:07 devstack sudo[114611]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32ca579c-e05d-489a-b418-fc1c9b2704b8" returned: 0 in 0.780s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.845s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-129521705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9172c32d-4a54-439e-8cbc-f00627de6181,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be3b0db03227495c9ffd2eb6d8aa1f71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:29:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:29:55Z,use_quota=True,user_id='933cba04e0f540acaf5aba81ce64a03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Creating volume 9172c32d-4a54-439e-8cbc-f00627de6181 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:30:07 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9172c32d-4a54-439e-8cbc-f00627de6181 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (022e852c-5e72-417d-9b97-10135aee23ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32ca579c-e05d-489a-b418-fc1c9b2704b8', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a061a4-e1fc-43e1-bef4-50f148ccd734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:07 devstack sudo[114616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9172c32d-4a54-439e-8cbc-f00627de6181 1073741824 Jun 25 17:30:07 devstack sudo[114616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:07 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Volume volume-32ca579c-e05d-489a-b418-fc1c9b2704b8 (32ca579c-e05d-489a-b418-fc1c9b2704b8): created successfully Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2a061a4-e1fc-43e1-bef4-50f148ccd734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Flow 'volume_create_manager' (29f8e0bf-21f5-4fa6-9320-c7e943b9393c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:07 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-301d716a-6006-49cd-83af-c3462918452f tempest-CreateVolumesFromSnapshotTest-615178772 None] Created volume successfully. Jun 25 17:30:07 devstack sudo[114613]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD" returned: 0 in 0.858s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:08 devstack sudo[114620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD Jun 25 17:30:08 devstack sudo[114620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:08 devstack sudo[114616]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9172c32d-4a54-439e-8cbc-f00627de6181 1073741824" returned: 0 in 1.032s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9172c32d-4a54-439e-8cbc-f00627de6181 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:08 devstack sudo[114626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9172c32d-4a54-439e-8cbc-f00627de6181 Jun 25 17:30:08 devstack sudo[114626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:08 devstack sudo[114620]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD" returned: 1 in 0.877s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:30:08 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Temporary image 6885732e-2a8f-4410-b2f2-3ce4fe737e01 is fetched for user 67a738037dde4c67bf6d9a942a8f36b0. {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 25 17:30:08 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c15f16-8fb6-4932-b2fe-6e7f1b0dcda3]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:09 devstack sudo[114631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD Jun 25 17:30:09 devstack sudo[114631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:09 devstack sudo[114626]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9172c32d-4a54-439e-8cbc-f00627de6181" returned: 0 in 0.942s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.037s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.774s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Acquiring lock "cinder-quobyte-67715d92-32c6-4f49-8f2f-6018c8a46038-1d3c5173-0f09-4484-91db-b70e0fd08cfd" by "_create_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a774f7bd-2e06-49da-9d2b-e3c819dd033b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9172c32d-4a54-439e-8cbc-f00627de6181', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498b9e41-b203-4172-8783-7298c84462bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Lock "cinder-quobyte-67715d92-32c6-4f49-8f2f-6018c8a46038-1d3c5173-0f09-4484-91db-b70e0fd08cfd" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Creating volume 1d3c5173-0f09-4484-91db-b70e0fd08cfd from snapshot 67715d92-32c6-4f49-8f2f-6018c8a46038 {{(pid=93869) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Acquiring lock "cinder-quobyte-1d3c5173-0f09-4484-91db-b70e0fd08cfd" by "_copy_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:09 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Volume volume-9172c32d-4a54-439e-8cbc-f00627de6181 (9172c32d-4a54-439e-8cbc-f00627de6181): created successfully Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498b9e41-b203-4172-8783-7298c84462bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Flow 'volume_create_manager' (7a606e7e-733c-4a5b-b38b-b220840da7c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Lock "cinder-quobyte-1d3c5173-0f09-4484-91db-b70e0fd08cfd" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] snapshot: 67715d92-32c6-4f49-8f2f-6018c8a46038, volume: 1d3c5173-0f09-4484-91db-b70e0fd08cfd, {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 17:30:09 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-a4d27292-6cf8-42be-9554-594653ef149e tempest-CreateVolumesFromSnapshotTest-615178772 None] Created volume successfully. Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d489c39-3ee1-453d-b38b-baee2d2250b3]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:09 devstack sudo[114634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038 Jun 25 17:30:09 devstack sudo[114634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:09 devstack sudo[114631]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD" returned: 0 in 0.950s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "cinder-9172c32d-4a54-439e-8cbc-f00627de6181-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-9172c32d-4a54-439e-8cbc-f00627de6181-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:10 devstack sudo[114638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD Jun 25 17:30:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "cinder-quobyte-9172c32d-4a54-439e-8cbc-f00627de6181" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:10 devstack sudo[114638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:10 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-quobyte-9172c32d-4a54-439e-8cbc-f00627de6181" acquired by "delete_volume" :: waited 0.017s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:10 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4f0ee5-b1aa-4de3-947d-806a552a5966]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9172c32d-4a54-439e-8cbc-f00627de6181 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:10 devstack sudo[114640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9172c32d-4a54-439e-8cbc-f00627de6181 Jun 25 17:30:10 devstack sudo[114640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:10 devstack sudo[114634]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038" returned: 0 in 1.049s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:30:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] will copy from snapshot at /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 17:30:10 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Creating direct copy from snapshot {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 17:30:10 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3895b1d-cd94-4dd8-a7c7-2be336682a38]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:10 devstack sudo[114645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 Jun 25 17:30:10 devstack sudo[114645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:10 devstack sudo[114638]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD" returned: 1 in 1.022s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:30:10 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:11 devstack sudo[114640]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9172c32d-4a54-439e-8cbc-f00627de6181" returned: 0 in 0.907s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9172c32d-4a54-439e-8cbc-f00627de6181 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:11 devstack sudo[114653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9172c32d-4a54-439e-8cbc-f00627de6181 Jun 25 17:30:11 devstack sudo[114653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:11 devstack sudo[114645]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9" returned: 0 in 1.077s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:11 devstack cinder-volume[93869]: DEBUG cinder.utils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Path /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1d3c5173-0f09-4484-91db-b70e0fd08cfd not found in is_blk_device check {{(pid=93869) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 17:30:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1d3c5173-0f09-4484-91db-b70e0fd08cfd {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:11 devstack sudo[114659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1d3c5173-0f09-4484-91db-b70e0fd08cfd Jun 25 17:30:11 devstack sudo[114659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:11 devstack sudo[114653]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-9172c32d-4a54-439e-8cbc-f00627de6181" returned: 0 in 0.799s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-quobyte-9172c32d-4a54-439e-8cbc-f00627de6181" released by "delete_volume" :: held 1.763s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:11 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] Created reservations ['88aebd72-24e6-4c81-bfed-087f65bbefab', 'eb245799-2d39-4943-8bb7-2c75fe403402', 'bd24e9e2-cac7-4238-acbc-6a3fab5e99c5', '3c89a737-9d80-4fd7-b296-03f773a09134'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:30:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:11 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:11 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:12 devstack sudo[114661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:30:12 devstack sudo[114661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:12 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "cinder-32ca579c-e05d-489a-b418-fc1c9b2704b8-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:12 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-32ca579c-e05d-489a-b418-fc1c9b2704b8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:12 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "cinder-quobyte-32ca579c-e05d-489a-b418-fc1c9b2704b8" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:12 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-quobyte-32ca579c-e05d-489a-b418-fc1c9b2704b8" acquired by "delete_volume" :: waited 0.024s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:12 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59b5f74-3d51-456d-b4c3-9203a9dc1832]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32ca579c-e05d-489a-b418-fc1c9b2704b8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:12 devstack sudo[114666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32ca579c-e05d-489a-b418-fc1c9b2704b8 Jun 25 17:30:12 devstack sudo[114666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:13 devstack sudo[114661]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.324s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:13 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:30:13 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] Deleted volume successfully. Jun 25 17:30:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-95948f70-9350-486a-8d94-9a9b724c2524 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-9172c32d-4a54-439e-8cbc-f00627de6181-delete_volume" released by "delete_volume" :: held 3.431s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:14 devstack sudo[114666]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32ca579c-e05d-489a-b418-fc1c9b2704b8" returned: 0 in 1.851s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32ca579c-e05d-489a-b418-fc1c9b2704b8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:14 devstack sudo[114680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32ca579c-e05d-489a-b418-fc1c9b2704b8 Jun 25 17:30:14 devstack sudo[114680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:16 devstack sudo[114680]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-32ca579c-e05d-489a-b418-fc1c9b2704b8" returned: 0 in 1.641s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:16 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-quobyte-32ca579c-e05d-489a-b418-fc1c9b2704b8" released by "delete_volume" :: held 3.574s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:16 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] Created reservations ['6b13ca33-b9ab-4a16-8195-cf6c540aa036', '3dfc1a71-2959-4561-8b06-6e7019244889', '8f3db226-be72-4ad8-a8a0-98b2802f97b6', '3d588a62-d79b-4e73-a1b1-ec42f87eeb4d'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:30:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:16 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:16 devstack sudo[114685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:30:16 devstack sudo[114685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "cinder-f5a3497f-0169-4958-8238-0bcf1e9725d3-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-f5a3497f-0169-4958-8238-0bcf1e9725d3-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "cinder-quobyte-f5a3497f-0169-4958-8238-0bcf1e9725d3" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-quobyte-f5a3497f-0169-4958-8238-0bcf1e9725d3" acquired by "delete_volume" :: waited 0.038s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:17 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16188e6-49e6-4c37-8c72-2d60e159eae5]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f5a3497f-0169-4958-8238-0bcf1e9725d3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:17 devstack sudo[114689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f5a3497f-0169-4958-8238-0bcf1e9725d3 Jun 25 17:30:17 devstack sudo[114689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:18 devstack sudo[114685]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.774s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:18 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:30:18 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] Deleted volume successfully. Jun 25 17:30:18 devstack sudo[114659]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1d3c5173-0f09-4484-91db-b70e0fd08cfd" returned: 0 in 6.459s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:18 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f091154c-59ef-4bb0-98e1-033117059833 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-32ca579c-e05d-489a-b418-fc1c9b2704b8-delete_volume" released by "delete_volume" :: held 5.848s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:18 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b5582e-3f52-47d4-af8f-6de0c4f6db60]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:18 devstack sudo[114692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 Jun 25 17:30:18 devstack sudo[114692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:18 devstack sudo[114689]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f5a3497f-0169-4958-8238-0bcf1e9725d3" returned: 0 in 1.197s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f5a3497f-0169-4958-8238-0bcf1e9725d3 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:18 devstack sudo[114698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f5a3497f-0169-4958-8238-0bcf1e9725d3 Jun 25 17:30:18 devstack sudo[114698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:19 devstack sudo[114692]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9" returned: 0 in 1.079s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:19 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Image conversion details: src /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9, size 1024.00 MB, duration 6.46 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1d3c5173-0f09-4484-91db-b70e0fd08cfd {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:30:19 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Converted 1024.00 MB image at 158.51 MB/s Jun 25 17:30:19 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1d3c5173-0f09-4484-91db-b70e0fd08cfd is being set with open permissions: ugo+rw Jun 25 17:30:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1d3c5173-0f09-4484-91db-b70e0fd08cfd {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:19 devstack sudo[114703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1d3c5173-0f09-4484-91db-b70e0fd08cfd Jun 25 17:30:19 devstack sudo[114703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:19 devstack sudo[114698]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-f5a3497f-0169-4958-8238-0bcf1e9725d3" returned: 0 in 0.776s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:19 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-quobyte-f5a3497f-0169-4958-8238-0bcf1e9725d3" released by "delete_volume" :: held 2.069s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:19 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] Created reservations ['0e8063c9-0fca-4184-9c12-e818cfa972dd', 'cce8c362-6130-45a9-935b-15bca3867e59', 'ab8e0283-1491-45d5-ae5f-fde5c7538c67', '29dd5e70-4f4e-4209-8364-fdcc712e80cc'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:30:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:19 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:19 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:19 devstack sudo[114706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:30:19 devstack sudo[114706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:20 devstack sudo[114703]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1d3c5173-0f09-4484-91db-b70e0fd08cfd" returned: 0 in 0.746s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Lock "cinder-quobyte-1d3c5173-0f09-4484-91db-b70e0fd08cfd" released by "_copy_volume_from_snapshot" :: held 10.576s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Lock "cinder-quobyte-67715d92-32c6-4f49-8f2f-6018c8a46038-1d3c5173-0f09-4484-91db-b70e0fd08cfd" released by "_create_volume_from_snapshot" :: held 10.641s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.691s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.249s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a824573-4743-4397-bfe1-f78fc4851454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfcc1b6140074b7fbd27f1b47cf168e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:06Z,use_quota=True,user_id='67a738037dde4c67bf6d9a942a8f36b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Creating volume 0a824573-4743-4397-bfe1-f78fc4851454 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:30:20 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:20 devstack sudo[114712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 1073741824 Jun 25 17:30:20 devstack sudo[114712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a22b8c0f-70bb-4fd5-90fd-316b8cc5c3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d3c5173-0f09-4484-91db-b70e0fd08cfd', 'volume_size': 1, 'snapshot_id': '67715d92-32c6-4f49-8f2f-6018c8a46038'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9acca1-5f7f-4724-9272-de0e9bc16179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:20 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Volume volume-1d3c5173-0f09-4484-91db-b70e0fd08cfd (1d3c5173-0f09-4484-91db-b70e0fd08cfd): created successfully Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9acca1-5f7f-4724-9272-de0e9bc16179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Flow 'volume_create_manager' (9bcc7918-5cb0-4edf-9dd4-88685e573e8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:20 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-51f3f026-9733-4411-9454-40fa60ecd1f9 tempest-VolumeDependencyTests-1907395917 None] Created volume successfully. Jun 25 17:30:20 devstack sudo[114706]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.954s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:30:20 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] Deleted volume successfully. Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5b79051c-65b0-4c83-a401-d853c3d974e6 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-f5a3497f-0169-4958-8238-0bcf1e9725d3-delete_volume" released by "delete_volume" :: held 3.418s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "cinder-4665c7b9-987a-4848-a9a8-c751e463aa99-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-4665c7b9-987a-4848-a9a8-c751e463aa99-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "cinder-quobyte-4665c7b9-987a-4848-a9a8-c751e463aa99" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-quobyte-4665c7b9-987a-4848-a9a8-c751e463aa99" acquired by "delete_volume" :: waited 0.026s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9053109-943a-4e04-9d43-71e610c72d02]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4665c7b9-987a-4848-a9a8-c751e463aa99 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:21 devstack sudo[114715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4665c7b9-987a-4848-a9a8-c751e463aa99 Jun 25 17:30:21 devstack sudo[114715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:21 devstack sudo[114712]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 1073741824" returned: 0 in 1.302s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:21 devstack sudo[114721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 Jun 25 17:30:21 devstack sudo[114721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] Acquiring lock "cinder-67715d92-32c6-4f49-8f2f-6018c8a46038-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] Lock "cinder-67715d92-32c6-4f49-8f2f-6018c8a46038-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] Acquiring lock "cinder-quobyte-e88ca21b-011f-4ba2-afc1-f5db5088c9b9" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] Lock "cinder-quobyte-e88ca21b-011f-4ba2-afc1-f5db5088c9b9" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] Acquiring lock "cinder-quobyte-67715d92-32c6-4f49-8f2f-6018c8a46038" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] Lock "cinder-quobyte-67715d92-32c6-4f49-8f2f-6018c8a46038" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] Deleting offline snapshot 67715d92-32c6-4f49-8f2f-6018c8a46038 of volume e88ca21b-011f-4ba2-afc1-f5db5088c9b9 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:30:21 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] snapshot_file for this snap is: volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:30:21 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[7702970d-8af1-4b28-bf10-b3dd7536f102]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:21 devstack sudo[114727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038 Jun 25 17:30:21 devstack sudo[114727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:21 devstack sudo[114715]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4665c7b9-987a-4848-a9a8-c751e463aa99" returned: 0 in 0.972s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4665c7b9-987a-4848-a9a8-c751e463aa99 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:21 devstack sudo[114729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4665c7b9-987a-4848-a9a8-c751e463aa99 Jun 25 17:30:21 devstack sudo[114729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:22 devstack sudo[114721]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454" returned: 0 in 0.842s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:22 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] <== create_volume: return (2223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:30:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.231s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:22 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Attempting download of 6885732e-2a8f-4410-b2f2-3ce4fe737e01 ((None, [{'url': 'file:///opt/stack/data/glance/images/6885732e-2a8f-4410-b2f2-3ce4fe737e01', 'metadata': {}}])) to volume 0a824573-4743-4397-bfe1-f78fc4851454. {{(pid=93869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 25 17:30:22 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fccd87-3b8b-45e6-afe1-c932a01ab942]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6885732e-2a8f-4410-b2f2-3ce4fe737e01_7rw63knv {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:22 devstack sudo[114732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6885732e-2a8f-4410-b2f2-3ce4fe737e01_7rw63knv Jun 25 17:30:22 devstack sudo[114732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:22 devstack sudo[114729]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-4665c7b9-987a-4848-a9a8-c751e463aa99" returned: 0 in 0.849s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:22 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-quobyte-4665c7b9-987a-4848-a9a8-c751e463aa99" released by "delete_volume" :: held 1.886s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:22 devstack sudo[114727]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038" returned: 0 in 1.083s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:22 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:30:22 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2b9c54-231b-4441-94f6-97e828483d55]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:22 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] Created reservations ['dfe39203-ae74-43d2-adbe-65519c37c8e8', '80f6efdf-c09c-4e07-a838-971abbb65ddb', 'a62b8a6c-389f-4ba5-9475-c73d7812302c', 'b8bb6dbc-f55a-4383-9828-a79415127983'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:30:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:23 devstack sudo[114739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:30:23 devstack sudo[114739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:23 devstack sudo[114738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 Jun 25 17:30:23 devstack sudo[114738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "cinder-5236bf79-8928-41cf-b1a3-86dc6af12cb8-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-5236bf79-8928-41cf-b1a3-86dc6af12cb8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "cinder-quobyte-5236bf79-8928-41cf-b1a3-86dc6af12cb8" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-quobyte-5236bf79-8928-41cf-b1a3-86dc6af12cb8" acquired by "delete_volume" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:23 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a067f602-59d2-4a0b-8766-0a5f1cd33958]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5236bf79-8928-41cf-b1a3-86dc6af12cb8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:23 devstack sudo[114742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5236bf79-8928-41cf-b1a3-86dc6af12cb8 Jun 25 17:30:23 devstack sudo[114742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:23 devstack sudo[114732]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6885732e-2a8f-4410-b2f2-3ce4fe737e01_7rw63knv" returned: 0 in 1.343s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6885732e-2a8f-4410-b2f2-3ce4fe737e01_7rw63knv {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:23 devstack sudo[114746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6885732e-2a8f-4410-b2f2-3ce4fe737e01_7rw63knv Jun 25 17:30:23 devstack sudo[114746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:24 devstack sudo[114739]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.057s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:24 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:30:24 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] Deleted volume successfully. Jun 25 17:30:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-dc5c2fb9-0d3a-4489-a72e-3e3e19bb1473 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-4665c7b9-987a-4848-a9a8-c751e463aa99-delete_volume" released by "delete_volume" :: held 3.335s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:24 devstack sudo[114738]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9" returned: 0 in 1.347s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:24 devstack sudo[114753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038 Jun 25 17:30:24 devstack sudo[114753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:24 devstack sudo[114742]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5236bf79-8928-41cf-b1a3-86dc6af12cb8" returned: 0 in 1.256s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5236bf79-8928-41cf-b1a3-86dc6af12cb8 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:24 devstack sudo[114760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5236bf79-8928-41cf-b1a3-86dc6af12cb8 Jun 25 17:30:24 devstack sudo[114760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:24 devstack sudo[114746]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6885732e-2a8f-4410-b2f2-3ce4fe737e01_7rw63knv" returned: 1 in 0.906s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6885732e-2a8f-4410-b2f2-3ce4fe737e01_7rw63knv' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:30:24 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbc1369-885c-44c7-b666-83537fff30df]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:24 devstack sudo[114762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD Jun 25 17:30:24 devstack sudo[114762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:25 devstack sudo[114753]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038" returned: 0 in 1.157s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:25 devstack sudo[114768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038 Jun 25 17:30:25 devstack sudo[114768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:25 devstack sudo[114760]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-5236bf79-8928-41cf-b1a3-86dc6af12cb8" returned: 0 in 0.772s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-quobyte-5236bf79-8928-41cf-b1a3-86dc6af12cb8" released by "delete_volume" :: held 2.102s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] Created reservations ['47febe9f-cc93-4c5f-b858-37f243bb4978', '12ce69c1-4619-453a-8d4e-c390bc139c6d', 'b28f75d8-e7bb-4320-94dc-d36eab71f882', 'a3448383-b39d-4e30-878c-e85a4c14ea79'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=103,cinder:UPDATE=124,cinder:INSERT=35,cinder:DELETE=9 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:25 devstack sudo[114772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:30:25 devstack sudo[114772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:25 devstack sudo[114762]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD" returned: 0 in 0.964s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "cinder-be52cbc3-9bce-4567-b7fe-5f13c96271a0-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-be52cbc3-9bce-4567-b7fe-5f13c96271a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "cinder-quobyte-725acb90-0861-4e15-855b-08c4505e639c" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-quobyte-725acb90-0861-4e15-855b-08c4505e639c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "cinder-quobyte-be52cbc3-9bce-4567-b7fe-5f13c96271a0" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-quobyte-be52cbc3-9bce-4567-b7fe-5f13c96271a0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] Deleting offline snapshot be52cbc3-9bce-4567-b7fe-5f13c96271a0 of volume 725acb90-0861-4e15-855b-08c4505e639c {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] snapshot_file for this snap is: volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9773248-243a-4289-9c42-f1a11edeb01d]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:25 devstack sudo[114774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD Jun 25 17:30:25 devstack sudo[114774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:26 devstack sudo[114775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0 Jun 25 17:30:26 devstack sudo[114775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:26 devstack sudo[114768]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9.67715d92-32c6-4f49-8f2f-6018c8a46038" returned: 0 in 0.979s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:26 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=97,cinder:UPDATE=148,cinder:DELETE=17,cinder:INSERT=36 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:30:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] Lock "cinder-quobyte-67715d92-32c6-4f49-8f2f-6018c8a46038" released by "_delete_snapshot" :: held 4.727s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] Lock "cinder-quobyte-e88ca21b-011f-4ba2-afc1-f5db5088c9b9" released by "delete_snapshot" :: held 4.761s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:26 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] Created reservations ['1e68ca72-5424-406f-9a2c-572020a88475', 'e3e80955-466d-43ae-aedc-b09f0247b803', '3f088cd0-7b9c-4c4c-ad98-1fe11531a34d', '0595fac4-bcb2-444a-96f6-1765e55b0a84'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:30:26 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] Delete snapshot completed successfully. Jun 25 17:30:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-21b5471d-2289-4f60-afa1-4f74f39092b2 tempest-VolumeDependencyTests-1907395917 None] Lock "cinder-67715d92-32c6-4f49-8f2f-6018c8a46038-delete_snapshot" released by "delete_snapshot" :: held 5.050s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:26 devstack sudo[114775]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0" returned: 0 in 1.011s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:26 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-725acb90-0861-4e15-855b-08c4505e639c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:30:26 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[33615eb4-c639-4b12-a21d-8c0c33ff34cb]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:26 devstack sudo[114774]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:26 devstack sudo[114772]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD" returned: 1 in 1.252s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:30:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.340s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:26 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] 6885732e-2a8f-4410-b2f2-3ce4fe737e01 was raw, converting to raw {{(pid=93869) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 25 17:30:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:26 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:30:26 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] Deleted volume successfully. Jun 25 17:30:26 devstack sudo[114787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 Jun 25 17:30:26 devstack sudo[114787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:27 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-fc814100-1b4b-49b6-8e34-96dc2fae8f0f tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-5236bf79-8928-41cf-b1a3-86dc6af12cb8-delete_volume" released by "delete_volume" :: held 3.760s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:27 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] Acquiring lock "cinder-e88ca21b-011f-4ba2-afc1-f5db5088c9b9-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:27 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] Lock "cinder-e88ca21b-011f-4ba2-afc1-f5db5088c9b9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:27 devstack sudo[114786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c Jun 25 17:30:27 devstack sudo[114786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:27 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] Acquiring lock "cinder-quobyte-e88ca21b-011f-4ba2-afc1-f5db5088c9b9" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:27 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] Lock "cinder-quobyte-e88ca21b-011f-4ba2-afc1-f5db5088c9b9" acquired by "delete_volume" :: waited 0.027s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:27 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1145769-9ed8-426b-b0da-541397c786e6]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:27 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:27 devstack sudo[114790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 Jun 25 17:30:27 devstack sudo[114790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:28 devstack sudo[114786]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c" returned: 0 in 1.135s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:28 devstack sudo[114787]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454" returned: 0 in 1.131s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:28 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6885732e-2a8f-4410-b2f2-3ce4fe737e01_rk_ygdiddevstack@QuobyteHD, size 0.00 MB, duration 1.13 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:30:28 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Converted 0.00 MB image at 0.00 MB/s Jun 25 17:30:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:28 devstack sudo[114801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0 Jun 25 17:30:28 devstack sudo[114801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:28 devstack sudo[114802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 1G Jun 25 17:30:28 devstack sudo[114802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:28 devstack sudo[114790]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9" returned: 0 in 0.970s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:28 devstack sudo[114805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9 Jun 25 17:30:28 devstack sudo[114805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:28 devstack sudo[114802]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 1G" returned: 0 in 0.879s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:28 devstack sudo[114805]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:28 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e88ca21b-011f-4ba2-afc1-f5db5088c9b9" returned: 0 in 0.791s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:29 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] Lock "cinder-quobyte-e88ca21b-011f-4ba2-afc1-f5db5088c9b9" released by "delete_volume" :: held 1.844s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:29 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8599e5-3217-4aa1-8fb9-335a1ad27a33]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:29 devstack sudo[114801]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0" returned: 0 in 1.070s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:29 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] Created reservations ['b16664c6-b8d6-4ff5-b6ec-0df8d84ed1db', 'f6e64dc8-cb73-493f-a252-de8ccaf3cbc4', '94b0138f-fad0-4525-bb51-162ab49c74de', '492b73e2-5840-420e-be78-98abc0a7d16c'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:30:29 devstack sudo[114817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0 Jun 25 17:30:29 devstack sudo[114817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:29 devstack sudo[114816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 Jun 25 17:30:29 devstack sudo[114816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:29 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:29 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:29 devstack sudo[114820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:30:29 devstack sudo[114820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:29 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] Acquiring lock "cinder-1d3c5173-0f09-4484-91db-b70e0fd08cfd-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:29 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] Lock "cinder-1d3c5173-0f09-4484-91db-b70e0fd08cfd-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:29 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] Acquiring lock "cinder-quobyte-1d3c5173-0f09-4484-91db-b70e0fd08cfd" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:29 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] Lock "cinder-quobyte-1d3c5173-0f09-4484-91db-b70e0fd08cfd" acquired by "delete_volume" :: waited 0.018s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:29 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1664ef9-0c1b-4e99-a6a5-54242f913cb7]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:29 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1d3c5173-0f09-4484-91db-b70e0fd08cfd {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:29 devstack sudo[114822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1d3c5173-0f09-4484-91db-b70e0fd08cfd Jun 25 17:30:29 devstack sudo[114822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:30 devstack sudo[114817]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c.be52cbc3-9bce-4567-b7fe-5f13c96271a0" returned: 0 in 0.985s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:30 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-quobyte-be52cbc3-9bce-4567-b7fe-5f13c96271a0" released by "_delete_snapshot" :: held 4.396s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:30 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-quobyte-725acb90-0861-4e15-855b-08c4505e639c" released by "delete_snapshot" :: held 4.438s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:30 devstack sudo[114816]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454" returned: 0 in 1.305s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:30 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] Created reservations ['40815024-50a5-40c0-a80e-9c1743fcac82', '0a6c90b9-ae7e-4f5c-bc63-4d49c7521fcb', '8ab07e74-ea50-414b-a814-62282d7d8af9', '2293903d-5244-43ac-87be-e72e33efb7be'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:30:30 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] Delete snapshot completed successfully. Jun 25 17:30:30 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5f6f429e-4f57-4f59-82f5-5c7b0484b9b4 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-be52cbc3-9bce-4567-b7fe-5f13c96271a0-delete_snapshot" released by "delete_snapshot" :: held 4.762s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:30 devstack sudo[114828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 Jun 25 17:30:30 devstack sudo[114828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:30 devstack sudo[114820]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.265s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:30 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:30:30 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] Deleted volume successfully. Jun 25 17:30:30 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-57a1b785-8c6b-49f8-9ad6-23dbc14d6960 tempest-VolumeDependencyTests-1907395917 None] Lock "cinder-e88ca21b-011f-4ba2-afc1-f5db5088c9b9-delete_volume" released by "delete_volume" :: held 3.508s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:30 devstack sudo[114822]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1d3c5173-0f09-4484-91db-b70e0fd08cfd" returned: 0 in 1.181s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:30 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1d3c5173-0f09-4484-91db-b70e0fd08cfd {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:30 devstack sudo[114834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1d3c5173-0f09-4484-91db-b70e0fd08cfd Jun 25 17:30:30 devstack sudo[114834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "cinder-725acb90-0861-4e15-855b-08c4505e639c-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-725acb90-0861-4e15-855b-08c4505e639c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "cinder-quobyte-725acb90-0861-4e15-855b-08c4505e639c" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-quobyte-725acb90-0861-4e15-855b-08c4505e639c" acquired by "delete_volume" :: waited 0.014s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:31 devstack sudo[114828]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454" returned: 1 in 0.972s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Downloaded image 6885732e-2a8f-4410-b2f2-3ce4fe737e01 ((None, [{'url': 'file:///opt/stack/data/glance/images/6885732e-2a8f-4410-b2f2-3ce4fe737e01', 'metadata': {}}])) to volume 0a824573-4743-4397-bfe1-f78fc4851454 successfully. {{(pid=93869) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Temporary image 6885732e-2a8f-4410-b2f2-3ce4fe737e01 for user 67a738037dde4c67bf6d9a942a8f36b0 is deleted. {{(pid=93869) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG cinder.volume.volume_utils [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Marking volume 0a824573-4743-4397-bfe1-f78fc4851454 as bootable. {{(pid=93869) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[441e19cc-5af5-41be-aca2-87b8fdbcb356]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Copying metadata from image 6885732e-2a8f-4410-b2f2-3ce4fe737e01 to 0a824573-4743-4397-bfe1-f78fc4851454. {{(pid=93869) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Creating volume glance metadata for volume 0a824573-4743-4397-bfe1-f78fc4851454 backed by image 6885732e-2a8f-4410-b2f2-3ce4fe737e01 with: {'image_id': '6885732e-2a8f-4410-b2f2-3ce4fe737e01', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ff2296ba464aed2ccfabcb34013a115b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93869) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7280eed3-4560-42c2-96dd-2f1ebeb969ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a824573-4743-4397-bfe1-f78fc4851454', 'volume_size': 1, 'image_id': '6885732e-2a8f-4410-b2f2-3ce4fe737e01', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6885732e-2a8f-4410-b2f2-3ce4fe737e01', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff2296ba464aed2ccfabcb34013a115b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'bfcc1b6140074b7fbd27f1b47cf168e3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '822296a5d905b0128b2afb941157f49b337d3fe5218877dce7b0793fd8e49f97cffd91c59d92400af61f036fa8fef1097eddd51476dab6134325542cbbc9ae74', 'id': '6885732e-2a8f-4410-b2f2-3ce4fe737e01', 'created_at': datetime.datetime(2026, 6, 25, 15, 30, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 25, 15, 30, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6885732e-2a8f-4410-b2f2-3ce4fe737e01/file', 'properties': {}}, 'image_service': }' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51cf3119-5108-4143-88e5-dc1de7edd621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:31 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Volume volume-0a824573-4743-4397-bfe1-f78fc4851454 (0a824573-4743-4397-bfe1-f78fc4851454): created successfully Jun 25 17:30:31 devstack sudo[114839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c Jun 25 17:30:31 devstack sudo[114839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51cf3119-5108-4143-88e5-dc1de7edd621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Flow 'volume_create_manager' (1c43855a-5cb7-4e79-ad97-f64bbefa0dc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:31 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-f54fa910-3764-43d0-befe-2ab62301205d tempest-VolumeImageDependencyTests-2049150443 None] Created volume successfully. Jun 25 17:30:31 devstack sudo[114834]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-1d3c5173-0f09-4484-91db-b70e0fd08cfd" returned: 0 in 0.781s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] Lock "cinder-quobyte-1d3c5173-0f09-4484-91db-b70e0fd08cfd" released by "delete_volume" :: held 2.028s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] Created reservations ['5de7388a-99a6-46f2-b24e-49a2b2ade8ee', 'a15b5745-c5a0-450c-b4df-be685fe4f373', 'b932783d-6935-4023-8b41-bdf507ff5e55', 'd8fcd0f1-1511-4041-97a2-62e0786c4473'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:31 devstack sudo[114842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:30:31 devstack sudo[114842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:31 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] Acquiring lock "cinder-0a824573-4743-4397-bfe1-f78fc4851454-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:32 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] Lock "cinder-0a824573-4743-4397-bfe1-f78fc4851454-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:32 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] Acquiring lock "cinder-quobyte-0a824573-4743-4397-bfe1-f78fc4851454" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:32 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] Lock "cinder-quobyte-0a824573-4743-4397-bfe1-f78fc4851454" acquired by "delete_volume" :: waited 0.030s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:32 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[12df8c25-bdca-4187-88c9-231cf60adebf]: (4, 'raw') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:32 devstack sudo[114847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 Jun 25 17:30:32 devstack sudo[114847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:32 devstack sudo[114839]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c" returned: 0 in 1.077s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:32 devstack sudo[114849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c Jun 25 17:30:32 devstack sudo[114849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:32 devstack sudo[114842]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:32 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.875s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:32 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:30:32 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] Deleted volume successfully. Jun 25 17:30:32 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-8eabeef6-7efb-4245-a792-72252cc9fc62 tempest-VolumeDependencyTests-1907395917 None] Lock "cinder-1d3c5173-0f09-4484-91db-b70e0fd08cfd-delete_volume" released by "delete_volume" :: held 3.245s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:33 devstack sudo[114847]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454" returned: 0 in 0.870s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:33 devstack sudo[114849]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-725acb90-0861-4e15-855b-08c4505e639c" returned: 0 in 0.799s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:33 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-quobyte-725acb90-0861-4e15-855b-08c4505e639c" released by "delete_volume" :: held 1.976s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:33 devstack sudo[114855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 Jun 25 17:30:33 devstack sudo[114855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:33 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] Created reservations ['41116506-ece8-4428-9a89-2d1a827d7de1', 'cdfba841-fc8f-4e7e-9bc7-8a82433f1b1d', '3dad9480-c712-483d-9e9e-f9cba550f0fb', '695d6d95-6477-4ab1-9ded-e6b56d26564b'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:30:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:33 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:33 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:33 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:33 devstack sudo[114857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:30:33 devstack sudo[114857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:34 devstack sudo[114855]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454" returned: 1 in 1.063s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454' failed. Not Retrying. {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 25 17:30:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:34 devstack sudo[114864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454 Jun 25 17:30:34 devstack sudo[114864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:34 devstack sudo[114857]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:34 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.806s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:34 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:30:34 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] Deleted volume successfully. Jun 25 17:30:34 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-b86efe22-10f6-4a40-9715-0054a352eb78 tempest-CreateVolumesFromSnapshotTest-615178772 None] Lock "cinder-725acb90-0861-4e15-855b-08c4505e639c-delete_volume" released by "delete_volume" :: held 3.144s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:35 devstack sudo[114864]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-0a824573-4743-4397-bfe1-f78fc4851454" returned: 0 in 0.885s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:35 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] Lock "cinder-quobyte-0a824573-4743-4397-bfe1-f78fc4851454" released by "delete_volume" :: held 2.922s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:35 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] Created reservations ['72890603-25f3-42a6-93af-55f3b8dce89f', '7361236d-cc38-4981-a685-d7bbed547a38', '9e06f066-d0f0-4e68-ab8f-ac3a40d07011', 'bf868a5a-ed0f-4b3c-a691-01f201a2133a'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:30:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:35 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:35 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:35 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:35 devstack sudo[114867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:30:35 devstack sudo[114867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:36 devstack sudo[114867]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:36 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.318s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:36 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:30:36 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] Deleted volume successfully. Jun 25 17:30:36 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-69f87cf1-2f59-4b51-8502-798e4f222ee4 tempest-VolumeImageDependencyTests-2049150443 None] Lock "cinder-0a824573-4743-4397-bfe1-f78fc4851454-delete_volume" released by "delete_volume" :: held 4.610s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Flow 'volume_create_manager' (2c1ad9c8-dcba-4ab7-998e-b6b11b880caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb25ce60-d8e5-4f44-8dfb-6dc3208f04d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb25ce60-d8e5-4f44-8dfb-6dc3208f04d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a8ff86-8bf4-408d-9616-7a98f9acc743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6a122045da402fb747871c0a1d6641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:38Z,use_quota=True,user_id='5d600cc6bdd64785bc53c9eeb12bfb94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c06005-c061-43ad-8eaf-86a7308b89ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c06005-c061-43ad-8eaf-86a7308b89ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd78e4e-7d54-4c0e-b8c7-661e203d0356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd78e4e-7d54-4c0e-b8c7-661e203d0356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88a8ff86-8bf4-408d-9616-7a98f9acc743', 'volume_name': 'volume-88a8ff86-8bf4-408d-9616-7a98f9acc743', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3ec103-7282-49ae-9f1f-2975baa77ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3ec103-7282-49ae-9f1f-2975baa77ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b6243e-69f9-409a-8ea3-4ecb40b3cae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:38 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Volume 88a8ff86-8bf4-408d-9616-7a98f9acc743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88a8ff86-8bf4-408d-9616-7a98f9acc743', 'volume_size': 1} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a8ff86-8bf4-408d-9616-7a98f9acc743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6a122045da402fb747871c0a1d6641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:38Z,use_quota=True,user_id='5d600cc6bdd64785bc53c9eeb12bfb94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Creating volume 88a8ff86-8bf4-408d-9616-7a98f9acc743 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:30:38 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:30:38 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-88a8ff86-8bf4-408d-9616-7a98f9acc743 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:38 devstack sudo[114904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-88a8ff86-8bf4-408d-9616-7a98f9acc743 1073741824 Jun 25 17:30:38 devstack sudo[114904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:40 devstack sudo[114904]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-88a8ff86-8bf4-408d-9616-7a98f9acc743 1073741824" returned: 0 in 1.407s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-88a8ff86-8bf4-408d-9616-7a98f9acc743 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:40 devstack sudo[114913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-88a8ff86-8bf4-408d-9616-7a98f9acc743 Jun 25 17:30:40 devstack sudo[114913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:40 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:30:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Flow 'volume_create_manager' (262e427a-da17-45ec-9e1e-c82ea8a9a1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a2b02b4-8b76-4470-9ecd-ad78e1f9b00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a2b02b4-8b76-4470-9ecd-ad78e1f9b00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1489637649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fed3aff3-2a1e-43c5-9052-c88cf106582d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8501b82af946be97da014b1e81cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:40Z,use_quota=True,user_id='b264c2a823214d76a6cdf2785519589a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269f2f52-d5b8-4452-9bb6-3e576f347040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269f2f52-d5b8-4452-9bb6-3e576f347040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53cafb70-93aa-47a9-9880-c4b6d70f53ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53cafb70-93aa-47a9-9880-c4b6d70f53ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fed3aff3-2a1e-43c5-9052-c88cf106582d', 'volume_name': 'volume-fed3aff3-2a1e-43c5-9052-c88cf106582d', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7cf577-90ca-4ba7-9391-aad599f48096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7cf577-90ca-4ba7-9391-aad599f48096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:40 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51fa7845-7f36-47b2-9651-5e7550796fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:40 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Volume fed3aff3-2a1e-43c5-9052-c88cf106582d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fed3aff3-2a1e-43c5-9052-c88cf106582d', 'volume_size': 1} Jun 25 17:30:40 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:41 devstack sudo[114913]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-88a8ff86-8bf4-408d-9616-7a98f9acc743" returned: 0 in 1.045s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] <== create_volume: return (2546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:30:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.554s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.441s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1489637649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fed3aff3-2a1e-43c5-9052-c88cf106582d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8501b82af946be97da014b1e81cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:40Z,use_quota=True,user_id='b264c2a823214d76a6cdf2785519589a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:30:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Creating volume fed3aff3-2a1e-43c5-9052-c88cf106582d {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:30:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:41 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:30:41 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:30:41 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fed3aff3-2a1e-43c5-9052-c88cf106582d 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:41 devstack sudo[114916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fed3aff3-2a1e-43c5-9052-c88cf106582d 1073741824 Jun 25 17:30:41 devstack sudo[114916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b6243e-69f9-409a-8ea3-4ecb40b3cae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88a8ff86-8bf4-408d-9616-7a98f9acc743', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81b26ab-85e7-4c41-af66-5934ed3133b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:41 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Volume volume-88a8ff86-8bf4-408d-9616-7a98f9acc743 (88a8ff86-8bf4-408d-9616-7a98f9acc743): created successfully Jun 25 17:30:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81b26ab-85e7-4c41-af66-5934ed3133b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:41 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Flow 'volume_create_manager' (2c1ad9c8-dcba-4ab7-998e-b6b11b880caa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:41 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-c6aade47-718b-4550-af7f-fb2922d8b7a3 tempest-CinderUnicodeTest-677695033 None] Created volume successfully. Jun 25 17:30:42 devstack sudo[114916]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fed3aff3-2a1e-43c5-9052-c88cf106582d 1073741824" returned: 0 in 1.114s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fed3aff3-2a1e-43c5-9052-c88cf106582d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:42 devstack sudo[114922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fed3aff3-2a1e-43c5-9052-c88cf106582d Jun 25 17:30:42 devstack sudo[114922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:42 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:30:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Flow 'volume_create_manager' (ec42337b-181a-4974-9823-0d6ab0732587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4cb1ac7-6c33-4545-a1a2-b9670905bffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4cb1ac7-6c33-4545-a1a2-b9670905bffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-102317964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbddd5ae-4a9e-4b62-b410-d45e85b4814d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6a122045da402fb747871c0a1d6641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:42Z,use_quota=True,user_id='5d600cc6bdd64785bc53c9eeb12bfb94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21ee608-753a-4d02-bf13-158b836a0589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21ee608-753a-4d02-bf13-158b836a0589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e43de6-24f9-422a-949c-d26acc19a24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e43de6-24f9-422a-949c-d26acc19a24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbddd5ae-4a9e-4b62-b410-d45e85b4814d', 'volume_name': 'volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c75bc409-98a5-4e16-a3d2-24825eae617c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c75bc409-98a5-4e16-a3d2-24825eae617c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:42 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edcef95-5739-4d37-96db-f256cf128bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:42 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Volume bbddd5ae-4a9e-4b62-b410-d45e85b4814d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d', 'volume_size': 1} Jun 25 17:30:42 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:43 devstack sudo[114922]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fed3aff3-2a1e-43c5-9052-c88cf106582d" returned: 0 in 0.857s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] <== create_volume: return (2027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:30:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.704s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-102317964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbddd5ae-4a9e-4b62-b410-d45e85b4814d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6a122045da402fb747871c0a1d6641',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:42Z,use_quota=True,user_id='5d600cc6bdd64785bc53c9eeb12bfb94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:30:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Creating volume bbddd5ae-4a9e-4b62-b410-d45e85b4814d {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:30:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:43 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:30:43 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:30:43 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51fa7845-7f36-47b2-9651-5e7550796fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fed3aff3-2a1e-43c5-9052-c88cf106582d', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:43 devstack sudo[114925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d 1073741824 Jun 25 17:30:43 devstack sudo[114925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f2cbe1-a571-4544-88a5-7aa063214068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:43 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Volume volume-fed3aff3-2a1e-43c5-9052-c88cf106582d (fed3aff3-2a1e-43c5-9052-c88cf106582d): created successfully Jun 25 17:30:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f2cbe1-a571-4544-88a5-7aa063214068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:43 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Flow 'volume_create_manager' (262e427a-da17-45ec-9e1e-c82ea8a9a1df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:43 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-56ae2af8-4f27-4880-b0c0-f56afde1c417 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Created volume successfully. Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:44 devstack sudo[114925]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d 1073741824" returned: 0 in 1.069s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:44 devstack sudo[114932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:30:44 devstack sudo[114932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:44 devstack sudo[114934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d Jun 25 17:30:44 devstack sudo[114934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Flow 'volume_create_manager' (fc7655ec-8cca-4621-a73f-6b253906a967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a23a9c86-208f-4268-8449-0d4a5df974b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a23a9c86-208f-4268-8449-0d4a5df974b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1733031118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21068569-ccd1-4f0e-8b1a-3303db6139f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8501b82af946be97da014b1e81cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:44Z,use_quota=True,user_id='b264c2a823214d76a6cdf2785519589a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2318d9-5d29-46a9-abe4-d720c043d9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a2318d9-5d29-46a9-abe4-d720c043d9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2ec0e1-493d-4606-ae30-c6f6c0befae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2ec0e1-493d-4606-ae30-c6f6c0befae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21068569-ccd1-4f0e-8b1a-3303db6139f1', 'volume_name': 'volume-21068569-ccd1-4f0e-8b1a-3303db6139f1', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678357ac-620d-47d6-a465-0dcbd70e1e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (678357ac-620d-47d6-a465-0dcbd70e1e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7092a87c-a7b4-4456-ba6c-41027629b9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:44 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Volume 21068569-ccd1-4f0e-8b1a-3303db6139f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21068569-ccd1-4f0e-8b1a-3303db6139f1', 'volume_size': 1} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Flow 'volume_create_manager' (4cf6ca5c-517c-4e17-b0bd-302040042ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b03b4f-f989-4eff-8f03-262b379bd71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b03b4f-f989-4eff-8f03-262b379bd71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-485029282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b82c4dd-05e1-4a28-9644-79fd7276a917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b842e4c460224627a3cd8dcef2fab34a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:45Z,use_quota=True,user_id='7e9e2fab5ec345b7872e427961292980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d22b287-c727-417e-aa57-c042d4ce7ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d22b287-c727-417e-aa57-c042d4ce7ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a72717-5904-4ac2-a07a-f1553ce20cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63a72717-5904-4ac2-a07a-f1553ce20cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b82c4dd-05e1-4a28-9644-79fd7276a917', 'volume_name': 'volume-6b82c4dd-05e1-4a28-9644-79fd7276a917', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdef21e1-b93e-46cd-ae8f-8fa5e0f72439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdef21e1-b93e-46cd-ae8f-8fa5e0f72439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab0738f-5734-4f85-a02d-0b49281c6ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:45 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Volume 6b82c4dd-05e1-4a28-9644-79fd7276a917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b82c4dd-05e1-4a28-9644-79fd7276a917', 'volume_size': 1} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Flow 'volume_create_manager' (785bc492-182b-4d08-b495-ea2d4f55b64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b527c0-54b3-47ed-9078-a65aae83e21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9b527c0-54b3-47ed-9078-a65aae83e21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2040207386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73c46c5-ed2d-46ce-91ba-8530e741a15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8501b82af946be97da014b1e81cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:45Z,use_quota=True,user_id='b264c2a823214d76a6cdf2785519589a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf21e4ed-9e90-46ea-a807-b7889a848f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf21e4ed-9e90-46ea-a807-b7889a848f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dc263ac-1520-4603-9b4b-7defeb78b436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dc263ac-1520-4603-9b4b-7defeb78b436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e73c46c5-ed2d-46ce-91ba-8530e741a15a', 'volume_name': 'volume-e73c46c5-ed2d-46ce-91ba-8530e741a15a', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed21b39a-baff-4937-b760-8f43ec654680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed21b39a-baff-4937-b760-8f43ec654680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c67248b8-6967-41a0-9b58-9c6d1a7e7c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:45 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Volume e73c46c5-ed2d-46ce-91ba-8530e741a15a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e73c46c5-ed2d-46ce-91ba-8530e741a15a', 'volume_size': 1} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Flow 'volume_create_manager' (4489d45f-07dd-4d26-a497-77390dc13b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d82b40-11d2-4144-81ab-f06b507b6378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d82b40-11d2-4144-81ab-f06b507b6378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1803254319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=039dcb78-e095-4c72-8e37-6e499cdf411f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8501b82af946be97da014b1e81cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:45Z,use_quota=True,user_id='b264c2a823214d76a6cdf2785519589a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1fc1ab2-b1ab-432e-98c7-084b0f498ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1fc1ab2-b1ab-432e-98c7-084b0f498ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950f5ff4-3492-4967-9f4b-09e25d7c742a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950f5ff4-3492-4967-9f4b-09e25d7c742a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '039dcb78-e095-4c72-8e37-6e499cdf411f', 'volume_name': 'volume-039dcb78-e095-4c72-8e37-6e499cdf411f', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c035abb3-acc7-4718-9a9b-e2844ba43fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c035abb3-acc7-4718-9a9b-e2844ba43fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee73293-8ac6-4476-8bb8-0889db7b7e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:45 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Volume 039dcb78-e095-4c72-8e37-6e499cdf411f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-039dcb78-e095-4c72-8e37-6e499cdf411f', 'volume_size': 1} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:45 devstack sudo[114932]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.069s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:30:45 devstack sudo[114934]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 28 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d" returned: 0 in 1.019s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] <== create_volume: return (2140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.144s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.773s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1733031118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21068569-ccd1-4f0e-8b1a-3303db6139f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8501b82af946be97da014b1e81cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:44Z,use_quota=True,user_id='b264c2a823214d76a6cdf2785519589a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Creating volume 21068569-ccd1-4f0e-8b1a-3303db6139f1 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:30:45 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-21068569-ccd1-4f0e-8b1a-3303db6139f1 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3edcef95-5739-4d37-96db-f256cf128bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:45 devstack sudo[114938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-21068569-ccd1-4f0e-8b1a-3303db6139f1 1073741824 Jun 25 17:30:45 devstack sudo[114938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0944eec1-cedd-46cc-a24e-3c20d7daa7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:45 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Volume volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d (bbddd5ae-4a9e-4b62-b410-d45e85b4814d): created successfully Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0944eec1-cedd-46cc-a24e-3c20d7daa7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Flow 'volume_create_manager' (ec42337b-181a-4974-9823-0d6ab0732587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:45 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-ed011da8-ec32-45e2-a39c-9877bc0ddae4 tempest-CinderUnicodeTest-677695033 None] Created volume successfully. Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Flow 'volume_create_manager' (584da099-d88e-4d4b-8d5c-adb132e40e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662028a3-54d2-4b5b-923a-7c944d7cc254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662028a3-54d2-4b5b-923a-7c944d7cc254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1686177195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ae481d-2c85-42f2-b749-251a345c99ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8501b82af946be97da014b1e81cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:46Z,use_quota=True,user_id='b264c2a823214d76a6cdf2785519589a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9c8bcb-108b-482f-a2ad-dddc68ab457b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9c8bcb-108b-482f-a2ad-dddc68ab457b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18c57dd-85db-4571-b40c-ebeeba6024fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e18c57dd-85db-4571-b40c-ebeeba6024fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68ae481d-2c85-42f2-b749-251a345c99ed', 'volume_name': 'volume-68ae481d-2c85-42f2-b749-251a345c99ed', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca01a12a-bee2-4eeb-8bc2-7db91ce5a084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca01a12a-bee2-4eeb-8bc2-7db91ce5a084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cca3e3b-a06c-464d-9b12-6c92e43e0922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:45 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Volume 68ae481d-2c85-42f2-b749-251a345c99ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68ae481d-2c85-42f2-b749-251a345c99ed', 'volume_size': 1} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:45 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6ce802c8-5039-41e1-9266-2bd1bea09f24 tempest-CinderUnicodeTest-677695033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:46 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:30:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Flow 'volume_create_manager' (c62acb32-2b78-4f5b-8297-753ff41cbc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122e85b6-f03e-4aae-909d-bb2dd3abe647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (122e85b6-f03e-4aae-909d-bb2dd3abe647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-27061812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c38174-745a-49e1-938f-405ad4276a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8501b82af946be97da014b1e81cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:46Z,use_quota=True,user_id='b264c2a823214d76a6cdf2785519589a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fcdec87-1fd2-40b1-af38-1df699c5e9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fcdec87-1fd2-40b1-af38-1df699c5e9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cf9f4e-13fb-40bb-9a0e-d691fb8ae2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7cf9f4e-13fb-40bb-9a0e-d691fb8ae2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99c38174-745a-49e1-938f-405ad4276a34', 'volume_name': 'volume-99c38174-745a-49e1-938f-405ad4276a34', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f592ce6-e0c2-42b8-ae92-d58737011793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f592ce6-e0c2-42b8-ae92-d58737011793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:46 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405ae6b3-02ff-426d-9eb0-e17fcc8e7d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:46 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Volume 99c38174-745a-49e1-938f-405ad4276a34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99c38174-745a-49e1-938f-405ad4276a34', 'volume_size': 1} Jun 25 17:30:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:46 devstack sudo[114938]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-21068569-ccd1-4f0e-8b1a-3303db6139f1 1073741824" returned: 0 in 1.116s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:46 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-21068569-ccd1-4f0e-8b1a-3303db6139f1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:46 devstack sudo[114944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-21068569-ccd1-4f0e-8b1a-3303db6139f1 Jun 25 17:30:46 devstack sudo[114944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:47 devstack sudo[114944]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-21068569-ccd1-4f0e-8b1a-3303db6139f1" returned: 0 in 0.691s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:30:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.189s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-485029282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b82c4dd-05e1-4a28-9644-79fd7276a917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b842e4c460224627a3cd8dcef2fab34a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:45Z,use_quota=True,user_id='7e9e2fab5ec345b7872e427961292980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:30:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Creating volume 6b82c4dd-05e1-4a28-9644-79fd7276a917 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:30:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:47 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:30:47 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:30:47 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7092a87c-a7b4-4456-ba6c-41027629b9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21068569-ccd1-4f0e-8b1a-3303db6139f1', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2b51df-4aca-465e-9d02-061741f71fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:47 devstack sudo[114947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 1073741824 Jun 25 17:30:47 devstack sudo[114947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:47 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Volume volume-21068569-ccd1-4f0e-8b1a-3303db6139f1 (21068569-ccd1-4f0e-8b1a-3303db6139f1): created successfully Jun 25 17:30:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e2b51df-4aca-465e-9d02-061741f71fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:47 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Flow 'volume_create_manager' (fc7655ec-8cca-4621-a73f-6b253906a967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:47 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-69ff04b7-522f-4af5-be27-e6ebe034117a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Created volume successfully. Jun 25 17:30:48 devstack sudo[114947]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 1073741824" returned: 0 in 0.901s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:48 devstack sudo[114953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 Jun 25 17:30:48 devstack sudo[114953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:48 devstack sudo[114953]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917" returned: 0 in 0.700s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:30:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.700s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2040207386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73c46c5-ed2d-46ce-91ba-8530e741a15a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8501b82af946be97da014b1e81cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:45Z,use_quota=True,user_id='b264c2a823214d76a6cdf2785519589a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:30:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Creating volume e73c46c5-ed2d-46ce-91ba-8530e741a15a {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:30:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:48 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:30:48 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:30:48 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e73c46c5-ed2d-46ce-91ba-8530e741a15a 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:48 devstack sudo[114956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e73c46c5-ed2d-46ce-91ba-8530e741a15a 1073741824 Jun 25 17:30:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab0738f-5734-4f85-a02d-0b49281c6ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b82c4dd-05e1-4a28-9644-79fd7276a917', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:48 devstack sudo[114956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b658972b-71df-405d-8161-4cdc2a98a2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:48 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Volume volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 (6b82c4dd-05e1-4a28-9644-79fd7276a917): created successfully Jun 25 17:30:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b658972b-71df-405d-8161-4cdc2a98a2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:48 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Flow 'volume_create_manager' (4cf6ca5c-517c-4e17-b0bd-302040042ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:48 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-a332236d-5ab3-4c40-a418-e60575b2fb5e tempest-SnapshotDependencyTests-1907347614 None] Created volume successfully. Jun 25 17:30:49 devstack sudo[114956]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e73c46c5-ed2d-46ce-91ba-8530e741a15a 1073741824" returned: 0 in 0.883s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e73c46c5-ed2d-46ce-91ba-8530e741a15a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:49 devstack sudo[114962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e73c46c5-ed2d-46ce-91ba-8530e741a15a Jun 25 17:30:49 devstack sudo[114962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:49 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b1c27f0d-61df-4094-bb7d-1d68ea7761b7 tempest-SnapshotDependencyTests-1907347614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:50 devstack sudo[114962]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e73c46c5-ed2d-46ce-91ba-8530e741a15a" returned: 0 in 0.657s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:30:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.143s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1803254319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=039dcb78-e095-4c72-8e37-6e499cdf411f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8501b82af946be97da014b1e81cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:45Z,use_quota=True,user_id='b264c2a823214d76a6cdf2785519589a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:30:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Creating volume 039dcb78-e095-4c72-8e37-6e499cdf411f {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:30:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:50 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:30:50 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:30:50 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-039dcb78-e095-4c72-8e37-6e499cdf411f 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c67248b8-6967-41a0-9b58-9c6d1a7e7c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e73c46c5-ed2d-46ce-91ba-8530e741a15a', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:50 devstack sudo[114965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-039dcb78-e095-4c72-8e37-6e499cdf411f 1073741824 Jun 25 17:30:50 devstack sudo[114965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4b80e6-f018-42b7-930e-66c0aa989873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:50 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Volume volume-e73c46c5-ed2d-46ce-91ba-8530e741a15a (e73c46c5-ed2d-46ce-91ba-8530e741a15a): created successfully Jun 25 17:30:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4b80e6-f018-42b7-930e-66c0aa989873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:50 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Flow 'volume_create_manager' (785bc492-182b-4d08-b495-ea2d4f55b64e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:50 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b31d844e-2cd8-4496-b061-a643d3048d6a tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Created volume successfully. Jun 25 17:30:51 devstack sudo[114965]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-039dcb78-e095-4c72-8e37-6e499cdf411f 1073741824" returned: 0 in 0.841s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:51 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-039dcb78-e095-4c72-8e37-6e499cdf411f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:51 devstack sudo[114971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-039dcb78-e095-4c72-8e37-6e499cdf411f Jun 25 17:30:51 devstack sudo[114971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:52 devstack sudo[114971]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-039dcb78-e095-4c72-8e37-6e499cdf411f" returned: 0 in 0.646s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:30:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.056s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1686177195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68ae481d-2c85-42f2-b749-251a345c99ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8501b82af946be97da014b1e81cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:46Z,use_quota=True,user_id='b264c2a823214d76a6cdf2785519589a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:30:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Creating volume 68ae481d-2c85-42f2-b749-251a345c99ed {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:30:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:52 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:30:52 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:30:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-68ae481d-2c85-42f2-b749-251a345c99ed 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:52 devstack sudo[114974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-68ae481d-2c85-42f2-b749-251a345c99ed 1073741824 Jun 25 17:30:52 devstack sudo[114974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee73293-8ac6-4476-8bb8-0889db7b7e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-039dcb78-e095-4c72-8e37-6e499cdf411f', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97b04bf-a96d-4e3d-8b5c-9b47a3c06bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:52 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Volume volume-039dcb78-e095-4c72-8e37-6e499cdf411f (039dcb78-e095-4c72-8e37-6e499cdf411f): created successfully Jun 25 17:30:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97b04bf-a96d-4e3d-8b5c-9b47a3c06bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:52 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Flow 'volume_create_manager' (4489d45f-07dd-4d26-a497-77390dc13b04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:52 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-4725efa1-4e9c-4001-ba88-4cee9bcfeaad tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Created volume successfully. Jun 25 17:30:52 devstack sudo[114974]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-68ae481d-2c85-42f2-b749-251a345c99ed 1073741824" returned: 0 in 0.852s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:52 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-68ae481d-2c85-42f2-b749-251a345c99ed {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:52 devstack sudo[114979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-68ae481d-2c85-42f2-b749-251a345c99ed Jun 25 17:30:52 devstack sudo[114979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:53 devstack sudo[114979]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-68ae481d-2c85-42f2-b749-251a345c99ed" returned: 0 in 0.655s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:53 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:30:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6ce802c8-5039-41e1-9266-2bd1bea09f24 tempest-CinderUnicodeTest-677695033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.568s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cca3e3b-a06c-464d-9b12-6c92e43e0922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68ae481d-2c85-42f2-b749-251a345c99ed', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b57b44-93a4-4d9a-87e1-0e2dd95f0f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:53 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-6ce802c8-5039-41e1-9266-2bd1bea09f24 tempest-CinderUnicodeTest-677695033 None] Creating offline snapshot 76a7e7bc-50c4-4db1-a0f3-c97dc0405f85 of volume bbddd5ae-4a9e-4b62-b410-d45e85b4814d {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:30:53 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Volume volume-68ae481d-2c85-42f2-b749-251a345c99ed (68ae481d-2c85-42f2-b749-251a345c99ed): created successfully Jun 25 17:30:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b57b44-93a4-4d9a-87e1-0e2dd95f0f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:53 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Flow 'volume_create_manager' (584da099-d88e-4d4b-8d5c-adb132e40e24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:53 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[69447535-7c45-4245-be4f-5956c9981373]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:53 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6ce802c8-5039-41e1-9266-2bd1bea09f24 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:53 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-5cd733b9-ae11-4cf5-87fa-711ad72721cc tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Created volume successfully. Jun 25 17:30:53 devstack sudo[114982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d Jun 25 17:30:53 devstack sudo[114982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:54 devstack sudo[114982]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6ce802c8-5039-41e1-9266-2bd1bea09f24 tempest-CinderUnicodeTest-677695033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d" returned: 0 in 0.803s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:54 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6ce802c8-5039-41e1-9266-2bd1bea09f24 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:54 devstack sudo[114988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85 1G Jun 25 17:30:54 devstack sudo[114988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:55 devstack sudo[114988]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6ce802c8-5039-41e1-9266-2bd1bea09f24 tempest-CinderUnicodeTest-677695033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85 1G" returned: 0 in 0.858s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:55 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6ce802c8-5039-41e1-9266-2bd1bea09f24 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:55 devstack sudo[114993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85 Jun 25 17:30:55 devstack sudo[114993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:56 devstack sudo[114993]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6ce802c8-5039-41e1-9266-2bd1bea09f24 tempest-CinderUnicodeTest-677695033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85" returned: 0 in 0.737s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:56 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-6ce802c8-5039-41e1-9266-2bd1bea09f24 tempest-CinderUnicodeTest-677695033 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85 is being set with open permissions: ugo+rw Jun 25 17:30:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6ce802c8-5039-41e1-9266-2bd1bea09f24 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:56 devstack sudo[114999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85 Jun 25 17:30:56 devstack sudo[114999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:56 devstack sudo[114999]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6ce802c8-5039-41e1-9266-2bd1bea09f24 tempest-CinderUnicodeTest-677695033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85" returned: 0 in 0.672s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:56 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6ce802c8-5039-41e1-9266-2bd1bea09f24 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:56 devstack sudo[115002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.info Jun 25 17:30:56 devstack sudo[115002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:57 devstack sudo[115002]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6ce802c8-5039-41e1-9266-2bd1bea09f24 tempest-CinderUnicodeTest-677695033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.info" returned: 0 in 0.673s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:57 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-6ce802c8-5039-41e1-9266-2bd1bea09f24 tempest-CinderUnicodeTest-677695033 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.info is being set with open permissions: ugo+rw Jun 25 17:30:57 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6ce802c8-5039-41e1-9266-2bd1bea09f24 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:57 devstack sudo[115005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.info Jun 25 17:30:57 devstack sudo[115005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:58 devstack sudo[115005]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6ce802c8-5039-41e1-9266-2bd1bea09f24 tempest-CinderUnicodeTest-677695033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.info" returned: 0 in 0.656s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6ce802c8-5039-41e1-9266-2bd1bea09f24 tempest-CinderUnicodeTest-677695033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.519s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.759s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-27061812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c38174-745a-49e1-938f-405ad4276a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f8501b82af946be97da014b1e81cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:30:46Z,use_quota=True,user_id='b264c2a823214d76a6cdf2785519589a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)}" {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Creating volume 99c38174-745a-49e1-938f-405ad4276a34 {{(pid=93869) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:30:58 devstack cinder-volume[93869]: INFO cinder.volume.drivers.remotefs [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] casted to osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-99c38174-745a-49e1-938f-405ad4276a34 1073741824 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:58 devstack sudo[115008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-99c38174-745a-49e1-938f-405ad4276a34 1073741824 Jun 25 17:30:58 devstack sudo[115008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:58 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-6ce802c8-5039-41e1-9266-2bd1bea09f24 tempest-CinderUnicodeTest-677695033 None] Create snapshot completed successfully Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] Acquiring lock "cinder-76a7e7bc-50c4-4db1-a0f3-c97dc0405f85-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] Lock "cinder-76a7e7bc-50c4-4db1-a0f3-c97dc0405f85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] Acquiring lock "cinder-quobyte-bbddd5ae-4a9e-4b62-b410-d45e85b4814d" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] Lock "cinder-quobyte-bbddd5ae-4a9e-4b62-b410-d45e85b4814d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] Acquiring lock "cinder-quobyte-76a7e7bc-50c4-4db1-a0f3-c97dc0405f85" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] Lock "cinder-quobyte-76a7e7bc-50c4-4db1-a0f3-c97dc0405f85" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] Deleting offline snapshot 76a7e7bc-50c4-4db1-a0f3-c97dc0405f85 of volume bbddd5ae-4a9e-4b62-b410-d45e85b4814d {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] snapshot_file for this snap is: volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[88740307-0261-4e71-b933-81f93361a929]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:58 devstack sudo[115010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85 Jun 25 17:30:58 devstack sudo[115010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:58 devstack sudo[115008]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-99c38174-745a-49e1-938f-405ad4276a34 1073741824" returned: 0 in 0.848s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:58 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-99c38174-745a-49e1-938f-405ad4276a34 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:59 devstack sudo[115016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-99c38174-745a-49e1-938f-405ad4276a34 Jun 25 17:30:59 devstack sudo[115016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:59 devstack sudo[115010]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85" returned: 0 in 0.843s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:30:59 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64bcb97-2e86-4a56-956a-46925b3863a7]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:59 devstack sudo[115027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d Jun 25 17:30:59 devstack sudo[115027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:30:59 devstack sudo[115016]: pam_unix(sudo:session): session closed for user root Jun 25 17:30:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-99c38174-745a-49e1-938f-405ad4276a34" returned: 0 in 0.671s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:30:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'} {{(pid=93869) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 25 17:30:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:30:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b1c27f0d-61df-4094-bb7d-1d68ea7761b7 tempest-SnapshotDependencyTests-1907347614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.712s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:30:59 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-b1c27f0d-61df-4094-bb7d-1d68ea7761b7 tempest-SnapshotDependencyTests-1907347614 None] Creating offline snapshot ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c of volume 6b82c4dd-05e1-4a28-9644-79fd7276a917 {{(pid=93869) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 25 17:30:59 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405ae6b3-02ff-426d-9eb0-e17fcc8e7d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99c38174-745a-49e1-938f-405ad4276a34', 'volume_size': 1}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:59 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc148fc-5fc9-47d4-8404-f9f952d6252f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:30:59 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0e1cd0-9f64-495e-b2a6-bc395382b40b]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:30:59 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b1c27f0d-61df-4094-bb7d-1d68ea7761b7 tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:30:59 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Volume volume-99c38174-745a-49e1-938f-405ad4276a34 (99c38174-745a-49e1-938f-405ad4276a34): created successfully Jun 25 17:30:59 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc148fc-5fc9-47d4-8404-f9f952d6252f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:30:59 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Flow 'volume_create_manager' (c62acb32-2b78-4f5b-8297-753ff41cbc9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:30:59 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-aa6ab679-2b85-4b6a-ace8-e4bbf1a8f6e4 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Created volume successfully. Jun 25 17:30:59 devstack sudo[115030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 Jun 25 17:30:59 devstack sudo[115030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:00 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "cinder-99c38174-745a-49e1-938f-405ad4276a34-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:00 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-99c38174-745a-49e1-938f-405ad4276a34-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:00 devstack sudo[115027]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d" returned: 0 in 0.883s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:00 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "cinder-quobyte-99c38174-745a-49e1-938f-405ad4276a34" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:00 devstack sudo[115035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85 Jun 25 17:31:00 devstack sudo[115035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:00 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-quobyte-99c38174-745a-49e1-938f-405ad4276a34" acquired by "delete_volume" :: waited 0.027s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:00 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d4e13c-6429-4832-ae1c-0cad010005d1]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:31:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-99c38174-745a-49e1-938f-405ad4276a34 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:00 devstack sudo[115039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-99c38174-745a-49e1-938f-405ad4276a34 Jun 25 17:31:00 devstack sudo[115039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:00 devstack sudo[115030]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b1c27f0d-61df-4094-bb7d-1d68ea7761b7 tempest-SnapshotDependencyTests-1907347614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917" returned: 0 in 0.870s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:00 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b1c27f0d-61df-4094-bb7d-1d68ea7761b7 tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c 1G {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:00 devstack sudo[115042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c 1G Jun 25 17:31:00 devstack sudo[115042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:01 devstack sudo[115035]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85" returned: 0 in 0.808s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:01 devstack sudo[115052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85 Jun 25 17:31:01 devstack sudo[115052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:01 devstack sudo[115039]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-99c38174-745a-49e1-938f-405ad4276a34" returned: 0 in 0.836s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-99c38174-745a-49e1-938f-405ad4276a34 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:01 devstack sudo[115055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-99c38174-745a-49e1-938f-405ad4276a34 Jun 25 17:31:01 devstack sudo[115055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:01 devstack sudo[115042]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b1c27f0d-61df-4094-bb7d-1d68ea7761b7 tempest-SnapshotDependencyTests-1907347614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c 1G" returned: 0 in 0.881s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b1c27f0d-61df-4094-bb7d-1d68ea7761b7 tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:01 devstack sudo[115058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c Jun 25 17:31:01 devstack sudo[115058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:01 devstack sudo[115052]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:01 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d.76a7e7bc-50c4-4db1-a0f3-c97dc0405f85" returned: 0 in 0.725s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] Lock "cinder-quobyte-76a7e7bc-50c4-4db1-a0f3-c97dc0405f85" released by "_delete_snapshot" :: held 3.385s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:01 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] Lock "cinder-quobyte-bbddd5ae-4a9e-4b62-b410-d45e85b4814d" released by "delete_snapshot" :: held 3.409s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:01 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] Created reservations ['430ab593-a1b9-40be-9c9b-c8a05f981e02', '1aaf1961-7d2a-4f05-837a-e5da0bf18f2f', 'cf24582a-d8eb-4b32-a2dc-9fb83f5a285a', '3cbaf47e-2246-4ba8-bc70-83f034b596dc'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:31:02 devstack sudo[115055]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-99c38174-745a-49e1-938f-405ad4276a34" returned: 0 in 0.781s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-quobyte-99c38174-745a-49e1-938f-405ad4276a34" released by "delete_volume" :: held 1.666s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:02 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] Delete snapshot completed successfully. Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9b14725b-df70-4eba-a75e-0ce1b6a5ef73 tempest-CinderUnicodeTest-677695033 None] Lock "cinder-76a7e7bc-50c4-4db1-a0f3-c97dc0405f85-delete_snapshot" released by "delete_snapshot" :: held 3.593s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Created reservations ['c263c26f-44e7-474b-83a2-3a21f32c927f', '912fdc62-30b8-4a70-988d-998c8ec7dd07', 'c3be0cc6-336e-4336-8eec-61bf9cb4e342', '61e385cf-2c1e-496e-bffa-9aa0e3336f9c'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:02 devstack sudo[115058]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b1c27f0d-61df-4094-bb7d-1d68ea7761b7 tempest-SnapshotDependencyTests-1907347614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 -F qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c" returned: 0 in 0.750s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:02 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-b1c27f0d-61df-4094-bb7d-1d68ea7761b7 tempest-SnapshotDependencyTests-1907347614 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c is being set with open permissions: ugo+rw Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b1c27f0d-61df-4094-bb7d-1d68ea7761b7 tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:02 devstack sudo[115065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:31:02 devstack sudo[115065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:02 devstack sudo[115066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c Jun 25 17:31:02 devstack sudo[115066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "cinder-68ae481d-2c85-42f2-b749-251a345c99ed-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-68ae481d-2c85-42f2-b749-251a345c99ed-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "cinder-quobyte-68ae481d-2c85-42f2-b749-251a345c99ed" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-quobyte-68ae481d-2c85-42f2-b749-251a345c99ed" acquired by "delete_volume" :: waited 0.032s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a91b8e5-630f-4034-a229-208d9f383297]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-68ae481d-2c85-42f2-b749-251a345c99ed {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] Acquiring lock "cinder-bbddd5ae-4a9e-4b62-b410-d45e85b4814d-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] Lock "cinder-bbddd5ae-4a9e-4b62-b410-d45e85b4814d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] Acquiring lock "cinder-quobyte-bbddd5ae-4a9e-4b62-b410-d45e85b4814d" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] Lock "cinder-quobyte-bbddd5ae-4a9e-4b62-b410-d45e85b4814d" acquired by "delete_volume" :: waited 0.030s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[921c12af-fdb7-4b3f-88a5-785684ea09fa]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:02 devstack sudo[115069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-68ae481d-2c85-42f2-b749-251a345c99ed Jun 25 17:31:02 devstack sudo[115069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:02 devstack sudo[115065]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.790s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:02 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:31:02 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Deleted volume successfully. Jun 25 17:31:03 devstack sudo[115066]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:03 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-64f034b7-dda6-4dcf-861a-040c467c80b3 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-99c38174-745a-49e1-938f-405ad4276a34-delete_volume" released by "delete_volume" :: held 2.722s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b1c27f0d-61df-4094-bb7d-1d68ea7761b7 tempest-SnapshotDependencyTests-1907347614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c" returned: 0 in 0.819s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b1c27f0d-61df-4094-bb7d-1d68ea7761b7 tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:03 devstack sudo[115073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d Jun 25 17:31:03 devstack sudo[115073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:03 devstack sudo[115074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.info Jun 25 17:31:03 devstack sudo[115074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:03 devstack sudo[115069]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-68ae481d-2c85-42f2-b749-251a345c99ed" returned: 0 in 1.011s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-68ae481d-2c85-42f2-b749-251a345c99ed {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:03 devstack sudo[115074]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b1c27f0d-61df-4094-bb7d-1d68ea7761b7 tempest-SnapshotDependencyTests-1907347614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.info" returned: 0 in 0.691s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:03 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-b1c27f0d-61df-4094-bb7d-1d68ea7761b7 tempest-SnapshotDependencyTests-1907347614 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.info is being set with open permissions: ugo+rw Jun 25 17:31:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b1c27f0d-61df-4094-bb7d-1d68ea7761b7 tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.info {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:03 devstack sudo[115085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-68ae481d-2c85-42f2-b749-251a345c99ed Jun 25 17:31:03 devstack sudo[115085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:03 devstack sudo[115086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.info Jun 25 17:31:03 devstack sudo[115086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:03 devstack sudo[115073]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d" returned: 0 in 0.871s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:03 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:03 devstack sudo[115089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d Jun 25 17:31:03 devstack sudo[115089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:04 devstack sudo[115085]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-68ae481d-2c85-42f2-b749-251a345c99ed" returned: 0 in 0.670s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-quobyte-68ae481d-2c85-42f2-b749-251a345c99ed" released by "delete_volume" :: held 1.773s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:04 devstack sudo[115086]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-b1c27f0d-61df-4094-bb7d-1d68ea7761b7 tempest-SnapshotDependencyTests-1907347614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.info" returned: 0 in 0.716s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-b1c27f0d-61df-4094-bb7d-1d68ea7761b7 tempest-SnapshotDependencyTests-1907347614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.851s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Created reservations ['29daff2c-b347-4e8f-ae1e-f223458a380f', 'b6e7b794-c1ca-4d04-9dd4-6f30966553f9', 'e906250e-22d9-4aa4-bce0-f61459b17dd1', '57898ef9-1a13-408a-bd22-516c8f8ae89b'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:31:04 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-b1c27f0d-61df-4094-bb7d-1d68ea7761b7 tempest-SnapshotDependencyTests-1907347614 None] Create snapshot completed successfully Jun 25 17:31:04 devstack sudo[115089]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-bbddd5ae-4a9e-4b62-b410-d45e85b4814d" returned: 0 in 0.736s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] Lock "cinder-quobyte-bbddd5ae-4a9e-4b62-b410-d45e85b4814d" released by "delete_volume" :: held 1.690s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:04 devstack sudo[115095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:31:04 devstack sudo[115095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] Created reservations ['a9469a30-09d0-4a24-8c45-a5516988cb23', 'f35c0a12-6e09-475b-98fd-db0da1a6a767', 'e70f946e-0cb6-423e-a9b7-49df84d01800', 'e0013eb8-ce06-48c3-969e-5dceaf385663'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:04 devstack sudo[115097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:31:04 devstack sudo[115097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "cinder-039dcb78-e095-4c72-8e37-6e499cdf411f-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-039dcb78-e095-4c72-8e37-6e499cdf411f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "cinder-quobyte-039dcb78-e095-4c72-8e37-6e499cdf411f" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-quobyte-039dcb78-e095-4c72-8e37-6e499cdf411f" acquired by "delete_volume" :: waited 0.022s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e66fe4d-3908-4e82-ab1d-4c5947dd808d]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:31:04 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-039dcb78-e095-4c72-8e37-6e499cdf411f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:05 devstack sudo[115099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-039dcb78-e095-4c72-8e37-6e499cdf411f Jun 25 17:31:05 devstack sudo[115099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] Acquiring lock "cinder-88a8ff86-8bf4-408d-9616-7a98f9acc743-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] Lock "cinder-88a8ff86-8bf4-408d-9616-7a98f9acc743-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] Acquiring lock "cinder-quobyte-88a8ff86-8bf4-408d-9616-7a98f9acc743" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] Lock "cinder-quobyte-88a8ff86-8bf4-408d-9616-7a98f9acc743" acquired by "delete_volume" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:05 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ea7d6b-9904-425c-b0d4-ba3402a736e3]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:31:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-88a8ff86-8bf4-408d-9616-7a98f9acc743 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:05 devstack sudo[115102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-88a8ff86-8bf4-408d-9616-7a98f9acc743 Jun 25 17:31:05 devstack sudo[115102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:05 devstack sudo[115095]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.899s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:05 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:31:05 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Deleted volume successfully. Jun 25 17:31:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-7382bd1d-cf08-4828-829e-748b79518763 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-68ae481d-2c85-42f2-b749-251a345c99ed-delete_volume" released by "delete_volume" :: held 3.007s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:05 devstack sudo[115097]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.840s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:05 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:31:05 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] Deleted volume successfully. Jun 25 17:31:05 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-f538d1ce-8e84-4194-a129-c4405306e230 tempest-CinderUnicodeTest-677695033 None] Lock "cinder-bbddd5ae-4a9e-4b62-b410-d45e85b4814d-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:05 devstack sudo[115099]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-039dcb78-e095-4c72-8e37-6e499cdf411f" returned: 0 in 0.928s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:05 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-039dcb78-e095-4c72-8e37-6e499cdf411f {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:05 devstack sudo[115109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-039dcb78-e095-4c72-8e37-6e499cdf411f Jun 25 17:31:05 devstack sudo[115109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:06 devstack sudo[115102]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-88a8ff86-8bf4-408d-9616-7a98f9acc743" returned: 0 in 1.020s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-88a8ff86-8bf4-408d-9616-7a98f9acc743 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:06 devstack sudo[115114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-88a8ff86-8bf4-408d-9616-7a98f9acc743 Jun 25 17:31:06 devstack sudo[115114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.flows.manager.create_volume [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93869) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Flow 'volume_create_manager' (6741dc7a-269f-4ad2-900a-11cfc3f50545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dfd1794-b478-49a7-a005-7b58d7bfdebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dfd1794-b478-49a7-a005-7b58d7bfdebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-25T15:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=182b25d7-22fd-47a5-97f5-130c6576ddac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b842e4c460224627a3cd8dcef2fab34a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-25T15:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-25T15:31:06Z,use_quota=True,user_id='7e9e2fab5ec345b7872e427961292980',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22ddf265-f646-4a20-894e-c40bf4812814),volume_type_id=22ddf265-f646-4a20-894e-c40bf4812814)' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cbb2c76-27c3-4207-829d-c6480e229338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cbb2c76-27c3-4207-829d-c6480e229338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e896bf-00ef-4498-9c86-646941b6c60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56e896bf-00ef-4498-9c86-646941b6c60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '182b25d7-22fd-47a5-97f5-130c6576ddac', 'volume_name': 'volume-182b25d7-22fd-47a5-97f5-130c6576ddac', 'volume_size': 1, 'snapshot_id': 'ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ccf19c-3845-47ca-852e-b0456b0ae501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ccf19c-3845-47ca-852e-b0456b0ae501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675d3338-c7da-4012-afb6-f32c1f807642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:31:06 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Volume 182b25d7-22fd-47a5-97f5-130c6576ddac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-182b25d7-22fd-47a5-97f5-130c6576ddac', 'volume_size': 1, 'snapshot_id': 'ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c'} Jun 25 17:31:06 devstack sudo[115109]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-039dcb78-e095-4c72-8e37-6e499cdf411f" returned: 0 in 0.762s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Acquiring lock "cinder-quobyte-ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c-182b25d7-22fd-47a5-97f5-130c6576ddac" by "_create_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-quobyte-039dcb78-e095-4c72-8e37-6e499cdf411f" released by "delete_volume" :: held 1.744s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Lock "cinder-quobyte-ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c-182b25d7-22fd-47a5-97f5-130c6576ddac" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Creating volume 182b25d7-22fd-47a5-97f5-130c6576ddac from snapshot ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c {{(pid=93869) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Selected osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868 as target Quobyte volume. {{(pid=93869) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Acquiring lock "cinder-quobyte-182b25d7-22fd-47a5-97f5-130c6576ddac" by "_copy_volume_from_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Lock "cinder-quobyte-182b25d7-22fd-47a5-97f5-130c6576ddac" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] snapshot: ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c, volume: 182b25d7-22fd-47a5-97f5-130c6576ddac, {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[209ec4f5-df30-4a37-84da-ba181c7eaa32]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Created reservations ['d043e1b8-7642-4d47-9d0e-388ca35e243d', 'b9127361-c01a-4a96-92ff-d37580f78ad3', '1a32fe8f-84af-4d3d-93de-1a7d554748aa', '1e078ae4-9b5d-430c-a914-1ee29b8a5d22'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:31:06 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:06 devstack sudo[115117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c Jun 25 17:31:06 devstack sudo[115117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:06 devstack sudo[115118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:31:06 devstack sudo[115118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:07 devstack sudo[115114]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-88a8ff86-8bf4-408d-9616-7a98f9acc743" returned: 0 in 0.749s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] Lock "cinder-quobyte-88a8ff86-8bf4-408d-9616-7a98f9acc743" released by "delete_volume" :: held 1.844s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "cinder-e73c46c5-ed2d-46ce-91ba-8530e741a15a-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-e73c46c5-ed2d-46ce-91ba-8530e741a15a-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "cinder-quobyte-e73c46c5-ed2d-46ce-91ba-8530e741a15a" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] Created reservations ['fb151477-c9dd-4a02-bb68-201eabcf076d', '2ac6bb79-c42c-433a-953e-9ef350f99e38', 'dbeea096-a811-4c26-bbdd-9f964de277ad', '648c0cbf-8d06-40e9-8380-e7c95cbdfad0'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-quobyte-e73c46c5-ed2d-46ce-91ba-8530e741a15a" acquired by "delete_volume" :: waited 0.032s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2bfb79-93a0-48e0-9407-7b2107765ea2]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e73c46c5-ed2d-46ce-91ba-8530e741a15a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:07 devstack sudo[115123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:31:07 devstack sudo[115123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:07 devstack sudo[115122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e73c46c5-ed2d-46ce-91ba-8530e741a15a Jun 25 17:31:07 devstack sudo[115122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:07 devstack sudo[115118]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.777s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:31:07 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Deleted volume successfully. Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-6e6d0d00-68c4-4363-a927-253843f06885 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-039dcb78-e095-4c72-8e37-6e499cdf411f-delete_volume" released by "delete_volume" :: held 2.854s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:07 devstack sudo[115117]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c" returned: 0 in 0.979s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b82c4dd-05e1-4a28-9644-79fd7276a917(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] will copy from snapshot at /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Creating direct copy from snapshot {{(pid=93869) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[342d0a8a-2410-42ce-8e7b-f52993934098]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:31:07 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:07 devstack sudo[115130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 Jun 25 17:31:07 devstack sudo[115130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:08 devstack sudo[115122]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e73c46c5-ed2d-46ce-91ba-8530e741a15a" returned: 0 in 0.906s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e73c46c5-ed2d-46ce-91ba-8530e741a15a {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:08 devstack sudo[115137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e73c46c5-ed2d-46ce-91ba-8530e741a15a Jun 25 17:31:08 devstack sudo[115137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:08 devstack sudo[115123]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.929s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:08 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:31:08 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] Deleted volume successfully. Jun 25 17:31:08 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-5ad38f9d-ff2c-4dc8-9b33-e74d4c385a78 tempest-CinderUnicodeTest-677695033 None] Lock "cinder-88a8ff86-8bf4-408d-9616-7a98f9acc743-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:08 devstack sudo[115130]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917" returned: 0 in 0.890s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:08 devstack cinder-volume[93869]: DEBUG cinder.utils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Path /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-182b25d7-22fd-47a5-97f5-130c6576ddac not found in is_blk_device check {{(pid=93869) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 25 17:31:08 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-182b25d7-22fd-47a5-97f5-130c6576ddac {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:08 devstack sudo[115142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-182b25d7-22fd-47a5-97f5-130c6576ddac Jun 25 17:31:08 devstack sudo[115142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:09 devstack sudo[115137]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-e73c46c5-ed2d-46ce-91ba-8530e741a15a" returned: 0 in 0.843s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-quobyte-e73c46c5-ed2d-46ce-91ba-8530e741a15a" released by "delete_volume" :: held 1.840s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:09 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Created reservations ['d93cab3e-585a-4d12-96de-1fa4d10d01f3', '3e9367cf-d457-4fd0-8dd7-de73d9571e69', '8bb10a74-57db-4c5f-8699-039b8a5e2f57', '5737f73b-edbb-45b3-9317-1a31bba6f5ed'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:31:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:31:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:31:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:31:09 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:31:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:31:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:09 devstack sudo[115148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:31:09 devstack sudo[115148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "cinder-21068569-ccd1-4f0e-8b1a-3303db6139f1-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-21068569-ccd1-4f0e-8b1a-3303db6139f1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "cinder-quobyte-21068569-ccd1-4f0e-8b1a-3303db6139f1" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:09 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-quobyte-21068569-ccd1-4f0e-8b1a-3303db6139f1" acquired by "delete_volume" :: waited 0.016s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:09 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cfa00c-80fb-4903-be8e-ce6bf5a4a38d]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:31:09 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-21068569-ccd1-4f0e-8b1a-3303db6139f1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:09 devstack sudo[115152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-21068569-ccd1-4f0e-8b1a-3303db6139f1 Jun 25 17:31:09 devstack sudo[115152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:11 devstack sudo[115148]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.871s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:11 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:31:11 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Deleted volume successfully. Jun 25 17:31:11 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-896517e8-8a09-4f53-96ad-01fcb4e73eb0 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-e73c46c5-ed2d-46ce-91ba-8530e741a15a-delete_volume" released by "delete_volume" :: held 4.051s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:11 devstack sudo[115152]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-21068569-ccd1-4f0e-8b1a-3303db6139f1" returned: 0 in 1.608s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:11 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-21068569-ccd1-4f0e-8b1a-3303db6139f1 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:11 devstack sudo[115166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-21068569-ccd1-4f0e-8b1a-3303db6139f1 Jun 25 17:31:11 devstack sudo[115166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:12 devstack sudo[115166]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-21068569-ccd1-4f0e-8b1a-3303db6139f1" returned: 0 in 1.284s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:12 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-quobyte-21068569-ccd1-4f0e-8b1a-3303db6139f1" released by "delete_volume" :: held 2.950s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:12 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Created reservations ['11779b51-7929-40dc-b3ba-b2c68ac072d2', '9752189e-9c2d-44c4-9358-d3a0c7cfc59c', '41f8a1e6-aba0-4333-b8e8-f4474a4361a0', '9f282a17-ef17-43b8-a5bd-345518b5ca61'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:31:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:31:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:31:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:31:12 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:31:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:31:12 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:12 devstack sudo[115169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:31:12 devstack sudo[115169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "cinder-fed3aff3-2a1e-43c5-9052-c88cf106582d-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-fed3aff3-2a1e-43c5-9052-c88cf106582d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "cinder-quobyte-fed3aff3-2a1e-43c5-9052-c88cf106582d" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:13 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-quobyte-fed3aff3-2a1e-43c5-9052-c88cf106582d" acquired by "delete_volume" :: waited 0.023s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:13 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b107740-7478-4cd4-ab5d-318547398ed3]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:31:13 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fed3aff3-2a1e-43c5-9052-c88cf106582d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:13 devstack sudo[115171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fed3aff3-2a1e-43c5-9052-c88cf106582d Jun 25 17:31:13 devstack sudo[115171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:14 devstack sudo[115169]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 1.435s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:14 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:31:14 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Deleted volume successfully. Jun 25 17:31:14 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-9146bc0b-e969-4a99-a33c-b21fb038e003 tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-21068569-ccd1-4f0e-8b1a-3303db6139f1-delete_volume" released by "delete_volume" :: held 4.767s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:14 devstack sudo[115142]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-182b25d7-22fd-47a5-97f5-130c6576ddac" returned: 0 in 6.050s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:14 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddd8553-45b5-45ef-b8c8-8375a2b24d7e]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:31:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:14 devstack sudo[115175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 Jun 25 17:31:14 devstack sudo[115175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:14 devstack sudo[115171]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fed3aff3-2a1e-43c5-9052-c88cf106582d" returned: 0 in 1.534s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:14 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fed3aff3-2a1e-43c5-9052-c88cf106582d {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:14 devstack sudo[115181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fed3aff3-2a1e-43c5-9052-c88cf106582d Jun 25 17:31:14 devstack sudo[115181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:15 devstack sudo[115181]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-fed3aff3-2a1e-43c5-9052-c88cf106582d" returned: 0 in 0.690s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:15 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-quobyte-fed3aff3-2a1e-43c5-9052-c88cf106582d" released by "delete_volume" :: held 2.327s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:15 devstack sudo[115175]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917" returned: 0 in 0.955s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:15 devstack cinder-volume[93869]: DEBUG cinder.image.image_utils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Image conversion details: src /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-182b25d7-22fd-47a5-97f5-130c6576ddac {{(pid=93869) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 25 17:31:15 devstack cinder-volume[93869]: INFO cinder.image.image_utils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Converted 1024.00 MB image at 169.22 MB/s Jun 25 17:31:15 devstack cinder-volume[93869]: WARNING cinder.volume.drivers.remotefs [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-182b25d7-22fd-47a5-97f5-130c6576ddac is being set with open permissions: ugo+rw Jun 25 17:31:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-182b25d7-22fd-47a5-97f5-130c6576ddac {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:15 devstack sudo[115187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-182b25d7-22fd-47a5-97f5-130c6576ddac Jun 25 17:31:15 devstack sudo[115187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:15 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Created reservations ['116f94dd-d85f-4541-9700-99ddf7558fb0', '1914dad2-8876-4e59-80e6-5b227eccf594', 'cda3f746-a6d0-46cd-90d9-1bfb527f26ac', 'a9fdf8e8-04f5-4c84-ba28-fdb919aa6b7b'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:31:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:31:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:31:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:31:15 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:31:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:31:15 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:15 devstack sudo[115189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:31:15 devstack sudo[115189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:16 devstack sudo[115187]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-182b25d7-22fd-47a5-97f5-130c6576ddac" returned: 0 in 0.657s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:16 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Lock "cinder-quobyte-182b25d7-22fd-47a5-97f5-130c6576ddac" released by "_copy_volume_from_snapshot" :: held 9.641s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:16 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Lock "cinder-quobyte-ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c-182b25d7-22fd-47a5-97f5-130c6576ddac" released by "_create_volume_from_snapshot" :: held 9.673s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.699s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:31:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675d3338-c7da-4012-afb6-f32c1f807642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-182b25d7-22fd-47a5-97f5-130c6576ddac', 'volume_size': 1, 'snapshot_id': 'ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c'}' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:31:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa7673c-52f1-4139-8b25-aae44830eba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 25 17:31:16 devstack cinder-volume[93869]: INFO cinder.volume.flows.manager.create_volume [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Volume volume-182b25d7-22fd-47a5-97f5-130c6576ddac (182b25d7-22fd-47a5-97f5-130c6576ddac): created successfully Jun 25 17:31:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baa7673c-52f1-4139-8b25-aae44830eba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93869) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 25 17:31:16 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Flow 'volume_create_manager' (6741dc7a-269f-4ad2-900a-11cfc3f50545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93869) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 25 17:31:16 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-883b3ead-2d0a-4aa4-88d9-42e79b9bbb44 tempest-SnapshotDependencyTests-1907347614 None] Created volume successfully. Jun 25 17:31:16 devstack sudo[115189]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:16 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.676s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:16 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:31:16 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Deleted volume successfully. Jun 25 17:31:16 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-e42c59ef-4dd0-4942-8226-05067c11860d tempest-CreateVolumesFromSourceVolumeTest-49621078 None] Lock "cinder-fed3aff3-2a1e-43c5-9052-c88cf106582d-delete_volume" released by "delete_volume" :: held 3.258s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] Acquiring lock "cinder-ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c-delete_snapshot" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] Lock "cinder-ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] Acquiring lock "cinder-quobyte-6b82c4dd-05e1-4a28-9644-79fd7276a917" by "delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] Lock "cinder-quobyte-6b82c4dd-05e1-4a28-9644-79fd7276a917" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] Acquiring lock "cinder-quobyte-ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c" by "_delete_snapshot" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:17 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] Lock "cinder-quobyte-ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] Deleting offline snapshot ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c of volume 6b82c4dd-05e1-4a28-9644-79fd7276a917 {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 25 17:31:17 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] snapshot_file for this snap is: volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c {{(pid=93869) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 25 17:31:17 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cda2fe3-e791-48f5-914f-f25b50f957ae]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:31:17 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:17 devstack sudo[115195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c Jun 25 17:31:17 devstack sudo[115195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:18 devstack sudo[115195]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c" returned: 0 in 0.752s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:18 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.remotefs [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b82c4dd-05e1-4a28-9644-79fd7276a917(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93869) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 25 17:31:18 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f915aa-1c7a-4b85-a0d3-2e82003797dc]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:31:18 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:18 devstack sudo[115200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 Jun 25 17:31:18 devstack sudo[115200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:19 devstack sudo[115200]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917" returned: 0 in 0.730s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:19 devstack sudo[115205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c Jun 25 17:31:19 devstack sudo[115205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:19 devstack sudo[115205]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c" returned: 0 in 0.771s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:19 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:20 devstack sudo[115210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c Jun 25 17:31:20 devstack sudo[115210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:20 devstack sudo[115210]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:20 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917.ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c" returned: 0 in 0.657s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] Lock "cinder-quobyte-ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c" released by "_delete_snapshot" :: held 3.039s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] Lock "cinder-quobyte-6b82c4dd-05e1-4a28-9644-79fd7276a917" released by "delete_snapshot" :: held 3.067s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:20 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] Created reservations ['8768c820-5980-4bfc-95ff-f702da58b38d', '140af2b1-f500-4b09-a5c7-3a27a0394c24', 'dd2761b7-202b-4510-9043-73c81bbd50a4', '52300916-deae-4b54-81d1-39a3c6f833f4'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:31:20 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] Delete snapshot completed successfully. Jun 25 17:31:20 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-c1cf2305-36e8-46bb-85a8-6b862a305062 tempest-SnapshotDependencyTests-1907347614 None] Lock "cinder-ee0eca8a-29eb-46e0-bb2c-d49e8b3ab30c-delete_snapshot" released by "delete_snapshot" :: held 3.196s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] Acquiring lock "cinder-6b82c4dd-05e1-4a28-9644-79fd7276a917-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] Lock "cinder-6b82c4dd-05e1-4a28-9644-79fd7276a917-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] Acquiring lock "cinder-quobyte-6b82c4dd-05e1-4a28-9644-79fd7276a917" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:21 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] Lock "cinder-quobyte-6b82c4dd-05e1-4a28-9644-79fd7276a917" acquired by "delete_volume" :: waited 0.019s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:21 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61a1ac0-e214-49a6-b885-8570c66b9e2f]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:31:21 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:22 devstack sudo[115213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 Jun 25 17:31:22 devstack sudo[115213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:22 devstack sudo[115213]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917" returned: 0 in 0.801s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:22 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:22 devstack sudo[115218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917 Jun 25 17:31:22 devstack sudo[115218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:23 devstack sudo[115218]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-6b82c4dd-05e1-4a28-9644-79fd7276a917" returned: 0 in 0.683s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:23 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] Lock "cinder-quobyte-6b82c4dd-05e1-4a28-9644-79fd7276a917" released by "delete_volume" :: held 1.542s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:23 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] Created reservations ['fab37c44-3b2f-4219-a1a5-0632ab8396e3', 'a6700df5-d1a1-4f1e-b6a1-ab4b20d33ecc', 'a1ff7b13-743f-4fa8-8128-04924bcae12d', 'ed9b0e4c-2d86-42c4-8ded-ca8a05111c20'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:31:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:31:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:31:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:31:23 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:31:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:31:23 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:23 devstack sudo[115221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:31:23 devstack sudo[115221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] Acquiring lock "cinder-182b25d7-22fd-47a5-97f5-130c6576ddac-delete_volume" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] Lock "cinder-182b25d7-22fd-47a5-97f5-130c6576ddac-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] Acquiring lock "cinder-quobyte-182b25d7-22fd-47a5-97f5-130c6576ddac" by "delete_volume" {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 25 17:31:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] Lock "cinder-quobyte-182b25d7-22fd-47a5-97f5-130c6576ddac" acquired by "delete_volume" :: waited 0.018s {{(pid=93869) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 25 17:31:24 devstack cinder-volume[93869]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c70d956-0bca-4ac1-90ee-5226515daf11]: (4, 'qcow2') {{(pid=95215) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 25 17:31:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-182b25d7-22fd-47a5-97f5-130c6576ddac {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:24 devstack sudo[115221]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.699s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:24 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:31:24 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] Deleted volume successfully. Jun 25 17:31:24 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-88651cb6-e2bf-463d-a7cd-6faeb5027e52 tempest-SnapshotDependencyTests-1907347614 None] Lock "cinder-6b82c4dd-05e1-4a28-9644-79fd7276a917-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:24 devstack sudo[115225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-182b25d7-22fd-47a5-97f5-130c6576ddac Jun 25 17:31:24 devstack sudo[115225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:24 devstack sudo[115225]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-182b25d7-22fd-47a5-97f5-130c6576ddac" returned: 0 in 0.771s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:24 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-182b25d7-22fd-47a5-97f5-130c6576ddac {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:24 devstack sudo[115230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-182b25d7-22fd-47a5-97f5-130c6576ddac Jun 25 17:31:24 devstack sudo[115230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:25 devstack sudo[115230]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488/volume-182b25d7-22fd-47a5-97f5-130c6576ddac" returned: 0 in 0.639s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:25 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] Lock "cinder-quobyte-182b25d7-22fd-47a5-97f5-130c6576ddac" released by "delete_volume" :: held 1.454s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:25 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=133,cinder:INSERT=49,cinder:UPDATE=147,cinder:DELETE=14 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:31:25 devstack cinder-volume[93869]: DEBUG cinder.quota [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] Created reservations ['a984b8aa-791e-45e5-949d-c233f344936e', 'd4381542-4cc7-40c2-871c-9295a38d3e4c', 'cbda4a65-91c3-43c2-b8f8-ef1716e93292', 'af99a239-f518-4636-b678-fbfa35e913bd'] {{(pid=93869) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 25 17:31:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:31:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:31:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:31:25 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:31:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:31:25 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:25 devstack sudo[115233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:31:25 devstack sudo[115233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:26 devstack sudo[115233]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:26 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.717s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:26 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:31:26 devstack cinder-volume[93869]: INFO cinder.volume.manager [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] Deleted volume successfully. Jun 25 17:31:26 devstack cinder-volume[93869]: DEBUG cinder.coordination [None req-14c0e829-d0f1-42bf-bc4d-a106fa23f2fe tempest-SnapshotDependencyTests-1907347614 None] Lock "cinder-182b25d7-22fd-47a5-97f5-130c6576ddac-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=93869) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 25 17:31:35 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=113,cinder:INSERT=42,cinder:UPDATE=184,cinder:DELETE=13 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:31:36 devstack cinder-volume[93869]: DEBUG dbcounter [-] [93869] Writing DB stats cinder:SELECT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=93869) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 25 17:31:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:31:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 25 17:31:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 25 17:31:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868': None} {{(pid=93869) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 25 17:31:44 devstack cinder-volume[93869]: DEBUG cinder.volume.drivers.quobyte [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3be700c4-3ff4-41b3-8db4-07ee8bff4868'] {{(pid=93869) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 25 17:31:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.lockutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93869) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 25 17:31:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 25 17:31:44 devstack sudo[115431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488 Jun 25 17:31:44 devstack sudo[115431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 25 17:31:44 devstack sudo[115431]: pam_unix(sudo:session): session closed for user root Jun 25 17:31:44 devstack cinder-volume[93869]: DEBUG oslo_concurrency.processutils [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/81e5a9fb186ee4c17cd007bd0029f488" returned: 0 in 0.674s {{(pid=93869) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 25 17:31:44 devstack cinder-volume[93869]: DEBUG cinder.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Notifying Schedulers of capabilities ... {{(pid=93869) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 25 17:31:44 devstack cinder-volume[93869]: DEBUG oslo_service.periodic_task [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] Running periodic task VolumeManager._thread_info {{(pid=93869) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 25 17:31:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread count: 28 {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 25 17:31:44 devstack cinder-volume[93869]: DEBUG cinder.volume.manager [None req-eb20b650-1851-4e60-aa31-1fb93a451a64 None None] thread info: [<_MainThread(MainThread, started 124958050308224)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93869) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}